Addition
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
10-digit addition 3 terms
89.56Token Accuracy
14
Addition
99.5Accuracy
7
Addition synthetic (val)
0.016Skill 1 Score
7
Addition T3 (val)
89.56Token Accuracy
6
Addition (OOD lengths 20-60)
45OOD Performance
4
ADDITIONBase-5 (test)
23.5Accuracy
4
ADDITIONBase-3 (test)
36.3Accuracy
4
ADDITIONBase-2 (test)
95.4Accuracy
4
Addition 200 prompts Qwen3-8B (test)
100Accuracy
3