资源分类
》 资源 》论文》LOGIC AND THE 2-S IMPLICIAL TRANSFORMER

LOGIC AND THE 2-S IMPLICIAL TRANSFORMER

2020-01-02 | |  112 |   90 |   0

Abstract

We introduce the 2-simplicial Transformer, an extension of the Transformer which includes a form of higher-dimensional attention generalising the dot-product attention, and uses this attention to update entity representations with tensor products of value vectors. We show that this architecture is a useful inductive bias for logical reasoning in the context of deep reinforcement learning.

上一篇：MEMORY-BASED GRAPH NETWORKS

下一篇：CAPSULES WITH INVERTED DOT-P RODUCTATTENTION ROUTING

用户评价
全部评价

热门资源

  • Deep Cross-media ...

    Cross-media retrieval is a research hotspot in ...

  • Regularizing RNNs...

    Recently, caption generation with an encoder-de...

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Joint Pose and Ex...

    Facial expression recognition (FER) is a challe...

  • Visual Reinforcem...

    For an autonomous agent to fulfill a wide range...