资源算法YellowFin_MXNet

YellowFin_MXNet

2020-02-20 | |  35 |   0 |   0

YellowFin

YellowFin is an auto-tuning optimizer based on momentum SGD which requires no manual specification of learning rate and momentum. It measures the objective landscape on-the-fly and tune momentum as well as learning rate using local quadratic approximation.

The implementation here can be a drop-in replacement for any optimizer in MXNet (So far we only implemented and tested upon SGD and other optimizers are in the to-do list).

For more technical details, please refer to the paper YellowFin and the Art of Momentum Tuning.


上一篇:Rotational-CoordConv

下一篇:YellowFin_Keras

用户评价
全部评价

热门资源

  • seetafaceJNI

    项目介绍 基于中科院seetaface2进行封装的JAVA...

  • spark-corenlp

    This package wraps Stanford CoreNLP annotators ...

  • Keras-ResNeXt

    Keras ResNeXt Implementation of ResNeXt models...

  • capsnet-with-caps...

    CapsNet with capsule-wise convolution Project ...

  • shih-styletransfer

    shih-styletransfer Code from Style Transfer ...