资源论文Trajectory of Alternating Direction Method of Multipliers and Adaptive Acceleration

Trajectory of Alternating Direction Method of Multipliers and Adaptive Acceleration

2020-02-19 | |  41 |   32 |   0

Abstract

The alternating direction method of multipliers (ADMM) is one of the most widely used first-order methods in the literature owing to its simplicity, flexibility and efficiency. Over the years, numerous efforts are made to improve the performance of ADMM, such as the inertial technique. By studying the geometric properties of ADMM, we discuss the limitations of current inertial accelerated ADMM, then present and analyze an adaptive acceleration scheme for the method. Numerical experiments on problems arising from image processing, statistics and machine learning demonstrate the advantages of the proposed acceleration approach.

上一篇:Enhancing the Locality and Breaking the MemoryBottleneck of Transformer on Time Series Forecasting

下一篇:Scalable inference of topic evolution via models for latent geometric structures

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...