资源算法tensorflow-nalu

tensorflow-nalu

2020-02-10 | |  78 |   0 |   0

Tensorflow NALU

A tensorflow implementation of Neural Arithmetic Logic Unit, Trask et al. Paper: https://arxiv.org/abs/1808.00508

Modifications to the original model

The NALU cell proposed in the paper had a major drawback that it can't model multiplication of negative inputs since multiplication is implemented as addition in log-space.

A solution to this was to avoid working in the log-space of the inputs and instead use the asinh function as porposed here: https://www.reddit.com/r/MachineLearning/comments/94833t/neural_arithmetic_logic_units/e3u974x/

Getting Started

from nalu.layers.nalu_layer import NaluLayer

nalu_layer = NaluLayer(FEATURES_NUM, OUTPUT_DIM, HIDDEN_DIM, N_CELLS, CORE_CELL_TYPE)
outputs = nalu_layer(input)


上一篇:nalu.pytorch

下一篇:NALUnit.js

用户评价
全部评价

热门资源

  • DuReader_QANet_BiDAF

    Machine Reading Comprehension on DuReader Usin...

  • ETD_cataloguing_a...

    ETD catalouging project using allennlp

  • honk-models

    Honk models google-speech-dataset.pt: model fo...

  • couleurs-des-van-...

    couleurs-des-van-gogh

  • allennlp_extras

    allennlp_extras Some utilities build on top of...