Algorithmic Reasoning on Algorithmic Tasks Length Generalization (l=41-120, test)
0.07PCminGRU
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| minGRUAggregation=Maximum across runs, Unseen Sequence Length=l = 41 to l = 1202026.02 | 0.07 | 0.04 | 0.09 | 0.09 | 0.08 | 0.1 | |
| LSTMAggregation=Maximum across runs, Unseen Sequence Length=l = 41 to l = 1202026.02 | 0.09 | 0.04 | 0.14 | 0.09 | 0.06 | 0.12 | |
| TransformerAggregation=Maximum across runs, Unseen Sequence Length=l = 41 to l = 1202026.02 | 0.27 | 0.56 | 0.21 | 0.65 | 0.42 | 0.22 | |
| NTMAggregation=Maximum across runs, Unseen Sequence Length=l = 41 to l = 1202026.02 | 1 | 1 | 1 | 1 | 1 | 1 | |
| P-NTMAggregation=Maximum across runs, Unseen Sequence Length=l = 41 to l = 1202026.02 | 1 | 1 | 1 | 1 | 1 | 1 |