资源论文Measuring Performance of Peer Prediction Mechanisms Using Replicator Dynamics

Measuring Performance of Peer Prediction Mechanisms Using Replicator Dynamics

2019-11-22 | |  35 |   35 |   0
Abstract Peer prediction is the problem of eliciting private, but correlated, information from agents. By rewarding an agent for the amount that their report “predicts” that of another agent, mechanisms can promote effort and truthful reports. A common concern in peer prediction is the multiplicity of equilibria, perhaps including high-payoff equilibria that reveal no information. Rather than assume agents counterspeculate and compute an equilibrium, we adopt replicator dynamics as a model for population learning. We take the size of the basin of attraction of the truthful equilibrium as a proxy for the robustness of truthful play. We study different mechanism designs, using models estimated from real peer evaluations in several massive online courses. Among other observations, we confirm that recent mechanisms present a significant improvement in robustness over earlier approaches.

上一篇:Simulating Human Inferences in the Light of New Information: A Formal Analysis

下一篇:DeepTransport: Prediction and Simulation of Human Mobility and Transportation Mode at a Citywide Level

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...