资源论文Deciding How to Decide: Dynamic Routing in Artificial Neural Networks

Deciding How to Decide: Dynamic Routing in Artificial Neural Networks

2020-03-10 | |  58 |   48 |   0

Abstract

We propose and systematically evaluate three strategies for training dynamically-routed artificial neural networks: graphs of learned transformations through which different input signals may take different paths. Though some approaches have advantages over others, the resulting networks are often qualitatively similar. We find that, in dynamically-routed networks trained to classify images, layers and branches become specialized to process distinct categories of images. Additionally, given a fixed computational budget, dynamically-routed networks tend to perform better than comparable staticallyrouted networks.

上一篇:Online Partial Least Square Optimization: Dropping Convexity for Better Efficiency and Scalability

下一篇:Self-Paced Co-training

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...