Modular Addition
Benchmarks
TaskDatasetSOTA resultTrendResults
Modular Addition (test)
100Accuracy (τ=0.1)
64
Modular Addition Token Embedding
99.4Match Accuracy
36
Modular Addition Angular Embedding (test)
0.999Match Accuracy
36
Modular Addition (train test)
5,000Grok
9
Modular Addition (train/test)
14Grokked Count
8
Modular Addition f_train=0.5 P=97
2,460Grokking Onset (epochs)
4