Multi-Query Associative Recall on MQAR npairs=24 (held-out)
1MQAR (held-out) Seed 42 ScoreVLA
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VLAnpairs=24, dh=32, Training steps=2000, Batch size=64, Held-out batches=152026.05 | 1 | 1 | 1 | 1 | 0 | |
| Softmaxnpairs=24, dh=32, Training steps=2000, Batch size=64, Held-out batches=152026.05 | 0.083 | 0.079 | 0.081 | 0.081 | 0.002 | |
| Linearnpairs=24, dh=32, Training steps=2000, Batch size=64, Held-out batches=152026.05 | 0.074 | 0.077 | 0.072 | 0.074 | 0.003 | |
| DeltaNetnpairs=24, dh=32, Training steps=2000, Batch size=64, Held-out batches=152026.05 | 0.011 | 0.009 | 0.012 | 0.011 | 0.002 |