资源论文A Novel Strategy for Active Task Assignment in Crowd Labeling

A Novel Strategy for Active Task Assignment in Crowd Labeling

2019-11-05 | |  55 |   35 |   0
Abstract Active learning strategies are often used in crowd labeling to improve the task assignment. However, these strategies, which evaluates each possible assignment at first and then greedily selects the optimal one, may require prohibitive computation time but still cannot improve the assignment to the utmost. Thus, we develop a novel strategy by firstly deriving an efficient algorithm for assignment evaluation. Then, to overcome the uncertainty of labels, we modulate the scope of the greedy task assignment with the posterior uncertainty and keep the evaluation being optimistic. The experiments on four popular worker models and four MTurk datasets show that our strategy achieves the best performance and highest computation efficiency.

上一篇:On the Cost Complexity of Crowdsourcing

下一篇:Deep Learning Based Multi-modal Addressee Recognition in Visual Scenes with Utterances

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...