资源分类
》 资源 》论文》Multiclass Performance Metric Elicitation

Multiclass Performance Metric Elicitation

2020-02-19 | |  57 |   44 |   0

Abstract 

Metric Elicitation is a principled framework for selecting the performance metric that best reflects implicit user preferences. However, available strategies have so far been limited to binary classification. In this paper, we propose novel strategies for eliciting multiclass classification performance metrics using only relative preference feedback. We also show that the strategies are robust to both finite sample and feedback noise.

上一篇：DualDICE: Behavior-Agnostic Estimation of Discounted Stationary Distribution Corrections

下一篇：Depth-First Proof-Number Search with Heuristic Edge Cost and Application to Chemical Synthesis Planning

用户评价
全部评价

热门资源

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...