资源分类
》 资源 》算法》pytorch_highway_networks

pytorch_highway_networks

2020-01-19 | |  37 |   0 |   0

PyTorch Highway Networks

Highway networks implemented in PyTorch.

Just the MNIST example from PyTorch hacked to work with Highway layers.

Todo

  • Make the Highway nn.Module reuseable and configurable.

  • Why does softmax work better than sigmoid? This shouldn't be the case...

  • Make training graphs on the MNIST dataset.

  • Add convolutional highway networks.

  • Add recurrent highway networks.

  • Experiment with convolutional highway networks for character embeddings.

Notes

  • ELU doesn't work better than RELU for the layer activation.

  • Softmax seems to work better than sigmoid for the gate function?!


上一篇：RecurrentHighwayNetworks

下一篇：highway-cnn

用户评价
全部评价

热门资源

  • Keras-ResNeXt

    Keras ResNeXt Implementation of ResNeXt models...

  • seetafaceJNI

    项目介绍 基于中科院seetaface2进行封装的JAVA...

  • spark-corenlp

    This package wraps Stanford CoreNLP annotators ...

  • capsnet-with-caps...

    CapsNet with capsule-wise convolution Project ...

  • inferno-boilerplate

    This is a very basic boilerplate example for pe...