资源论文Information-theoretic lower bounds for distributed statistical estimation with communication constraints

Information-theoretic lower bounds for distributed statistical estimation with communication constraints

2020-01-16 | |  59 |   36 |   0

Abstract

We establish lower bounds on minimax risks for distributed statistical estimation under a communication budget. Such lower bounds reveal the minimum amount of communication required by any procedure to achieve the centralized minimax-optimal rates for statistical estimation. We study two classes of protocols: one in which machines send messages independently, and a second allowing for interactive communication. We establish lower bounds for several problems, including various types of location models, as well as for parameter estimation in regression models.

上一篇:Streaming Variational Bayes

下一篇:Eluder Dimension and the Sample Complexity of Optimistic Exploration

用户评价
全部评价

热门资源

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • Rating-Boosted La...

    The performance of a recommendation system reli...

  • Hierarchical Task...

    We extend hierarchical task network planning wi...