资源论文On the Cost Complexity of Crowdsourcing

On the Cost Complexity of Crowdsourcing

2019-11-05 | |  145 |   133 |   0
Abstract Existing efforts mainly use empirical analysis to evaluate the effectiveness of crowdsourcing methods, which is often unreliable across experimental settings. Consequently, it is of great importance to study theoretical methods. This work, for the first time, defines the cost complexity of crowdsourcing, and presents two theorems to compute the cost complexity. Our theorems provide a general theoretical method to model the trade-off between costs and quality, which can be used to evaluate and design crowdsourcing algorithms, and characterize the complexity of crowdsourcing problems. Moreover, following our theorems, we prove a set of corollaries that can obtain existing theoretical results for special cases. We have verified our work theoretically and empirically.

上一篇:Master-Slave Curriculum Design for Reinforcement Learning

下一篇:A Novel Strategy for Active Task Assignment in Crowd Labeling

用户评价
全部评价

热门资源

  • Regularizing RNNs...

    Recently, caption generation with an encoder-de...

  • Deep Cross-media ...

    Cross-media retrieval is a research hotspot in ...

  • Learning Expressi...

    Facial expression is temporally dynamic event w...

  • Compact MDDs for ...

    Pseudo-Boolean (PB) constraints are usually en...

  • Attributed Graph ...

    Graph clustering is a fundamental task which di...