资源分类
》 资源 》论文》Aggregating Ordinal Labels from Crowds by Minimax Conditional Entropy

Aggregating Ordinal Labels from Crowds by Minimax Conditional Entropy

2020-03-03 | |  52 |   37 |   0

Abstract

We propose a method to aggregate noisy ordinal labels collected from a crowd of workers or annotators. Eliciting ordinal labels is important in tasks such as judging web search quality and rating products. Our method is motivated by the observation that workers usually have difficulty distinguishing between two adjacent ordinal classes whereas distinguishing between two classes which are far away from each other is much easier. We formulate our method as minimax conditional entropy subject to constraints which encode this observation. Empirical evaluations on real datasets demonstrate significant improvements over existing methods.

上一篇：Learning Complex Neural Network Policies with Trajectory Optimization

下一篇：A Physics-Based Model Prior for Object-Oriented MDPs

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...