Arithmetic Addition
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Arithmetic Addition Base 5, OOD-10x
17.2Token Accuracy
4
Arithmetic Addition Base 5, OOD-5x
17.3Token-wise Accuracy
4
Arithmetic Addition Base 5, OOD-2x
18.8Token-wise Accuracy
4
Arithmetic Addition Base 5, ID n=5
23Token-wise Accuracy
4
Arithmetic Addition Base 3 OOD-10x
31Token-wise Accuracy
4
Arithmetic Addition Base 3 OOD-5x
30.7Token-wise Accuracy
4
Arithmetic Addition Base 3 OOD-2x
31.4Token-wise Accuracy
4
Arithmetic Addition Base 3 ID n=5
36.6Token-wise Accuracy
4