资源论文The LASSO risk: asymptotic results and real world examples

The LASSO risk: asymptotic results and real world examples

2020-01-06 | |  62 |   45 |   0

Abstract We consider the problem of learning a coefficient vector 图片.png from noisy linear observation 图片.pngIn many contexts (ranging from model selection to image processing) it is desirable to construct a sparse estimator 图片.png In this case, a popular approach consists in solving an 图片.png-penalized least squares problem known as the LASSO or Basis Pursuit DeNoising (BPDN). For sequences of matrices A of increasing dimensions, with independent gaussian entries, we prove that the normalized risk of the LASSO converges to a limit, and we obtain an explicit expression for this limit. Our result is the first rigorous derivation of an explicit formula for the asymptotic mean square error of the LASSO for random instances. The proof technique is based on the analysis of AMP, a recently developed efficient algorithm, that is inspired from graphical models ideas. Through simulations on real data matrices (gene expression data and hospital medical records) we observe that these results can be relevant in a broad array of practical applications.

上一篇:Divisive Normalization: Justification and Effectiveness as Efficient Coding Transform

下一篇:Probabilistic Deterministic Infinite Automata

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...