New Neural Trick Helps Models Think in Longer Patterns
:::info
Authors:
(1) Hung Le, Applied AI Institute, Deakin University, Geelong, Australia;
(2) Dung Nguyen, Applied AI Institute, Deakin University, Geelong, Australia;
(3) Kien Do, Applied AI Institute, Deakin University, Geelong, Australia;
(4) Svetha Venkatesh, Applied AI Institute, Deakin University, Geelong, Australia;
(5) Truyen Tran, Applied AI Institute, Deakin University, Geelong, Australia.
:::
Table of Links
Related Works, Discussion, & References
2.3 Pointer-Augmented Neural Memory (PANM)
\
2.3.1 Pointer Unit
\
\
2.3.2 Pointer-based Addressing Modes
\
\
2.3.3 The Controller
\
\
\
![Table 2: SCAN (Left): Exact match accuracy (%, median of 5 runs) on splits of various lengths. Mathematics (Right): mean accuracy over 5 runs. The baselines’ numbers are from Csord´as et al. [2021] and we run PANM using the authors’ codebase.](https://cdn.hackernoon.com/images/fWZa4tUiBGemnqQfBGgCPf9594N2-h2d30i6.png)
\
:::info
This paper is available on arxiv under CC BY 4.0 DEED license.
:::
\
