资源论文On the Sample Complexity of Robust PCA

On the Sample Complexity of Robust PCA

2020-01-13 | |  54 |   35 |   0

Abstract

We estimate the rate of convergence and sample complexity of a recent robust estimator for a generalized version of the inverse covariance matrix. This estimator is used in a convex algorithm for robust subspace recovery (i.e., robust PCA). Our model assumes a sub-Gaussian underlying distribution and an i.i.d. sample from it. Our main result shows with high probability that the norm of the difference between the generalized inverse covariance of the underlying distribution and its estimator from an i.i.d. sample of size N is of order 图片.png for arbitrarily small  图片.png (affecting the probabilistic estimate); this rate of convergence is close to the one of direct covariance estimation, i.e., 图片.png Our precise probabilistic estimate implies for some natural settings that the sample complexity of the generalized inverse covariance estimation when using the Frobenius norm is 图片.png for arbitrarily small 图片.png (whereas the sample complexity of direct covariance estimation with Frobenius norm is 图片.png These results provide similar rates of convergence and sample complexity for the corresponding robust subspace recovery algorithm. To the best of our knowledge, this is the only work analyzing the sample complexity of any robust PCA algorithm.

上一篇:Fast Variational Inference in the Conjugate Exponential Family

下一篇:Action-Model Based Multi-agent Plan Recognition

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • Learning to learn...

    The move from hand-designed features to learned...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...