Memory Recall on noisy_long_recall primary memory benchmark
100Success RateAURA-Mem
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AURA-MemGate type=Action-utility surprise, State budget (dk)=64, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 100 | 2.18 | 9.19 | |
| write_every_stepGate type=Forced ON (no gate), State budget (dk)=16, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 100 | — | — | |
| write_every_stepGate type=Forced ON (no gate), State budget (dk)=32, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 100 | — | — | |
| write_every_stepGate type=Forced ON (no gate), State budget (dk)=64, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 100 | 20 | — | |
| fixed_size_stateGate type=Forced ON (same cell), State budget (dk)=16, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 100 | — | — | |
| fixed_size_stateGate type=Forced ON (same cell), State budget (dk)=32, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 100 | — | — | |
| fixed_size_stateGate type=Forced ON (same cell), State budget (dk)=64, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 100 | 20 | — | |
| AURA-MemGate type=Action-utility surprise, State budget (dk)=32, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 95.5 | — | 4.98 | |
| AURA-MemGate type=Action-utility surprise, State budget (dk)=16, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 90.1 | — | 7.13 | |
| full_recurrenceGate type=GRU (no fast-weight), State budget (dk)=16, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 88.3 | — | — | |
| full_recurrenceGate type=GRU (no fast-weight), State budget (dk)=32, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 87.3 | — | — | |
| full_recurrenceGate type=GRU (no fast-weight), State budget (dk)=64, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 84.8 | 20 | — | |
| learned_token_gateGate type=Token-loss gate†, State budget (dk)=64, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 49.4 | 0 | — | |
| learned_token_gateGate type=Token-loss gate†, State budget (dk)=32, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 44.4 | — | — | |
| periodic_writeGate type=Periodic at ρ, State budget (dk)=32, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 37.5 | — | — | |
| periodic_writeGate type=Periodic at ρ, State budget (dk)=64, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 37.4 | 2.92 | — | |
| random_writeGate type=Random at ρ, State budget (dk)=32, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 36.8 | — | — | |
| random_writeGate type=Random at ρ, State budget (dk)=16, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 36.6 | — | — | |
| periodic_writeGate type=Periodic at ρ, State budget (dk)=16, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 36.6 | — | — | |
| random_writeGate type=Random at ρ, State budget (dk)=64, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 36.5 | 2.98 | — | |
| learned_token_gateGate type=Token-loss gate†, State budget (dk)=16, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 25.7 | — | — | |
| no_memoryGate type=None (chance floor), State budget (dk)=16, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 25.7 | — | — | |
| no_memoryGate type=None (chance floor), State budget (dk)=32, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 25.6 | — | — | |
| no_memoryGate type=None (chance floor), State budget (dk)=64, Nk=16, Nv=8, T=96, Training steps=40002026.06 | 25.4 | 0 | — |