资源分类
》 资源 》论文》Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representations

Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representations

2020-02-10 | |  67 |   48 |   0

Abstract 

We present a new approach to learn compressible representations in deep architectures with an end-to-end training strategy. Our method is based on a soft (continuous) relaxation of quantization and entropy, which we anneal to their discrete counterparts throughout training. We showcase this method for two challenging applications: Image compression and neural network compression. While these tasks have typically been approached with different methods, our soft-to-hard quantization approach gives results competitive with the state-of-the-art for both.

上一篇：A PAC-Bayesian Analysis of Randomized Learning with Application to Stochastic Gradient Descent

下一篇：Hierarchical Methods of Moments

用户评价
全部评价

热门资源

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...