ResearchBenchmarksModular Arithmetic on Formal-language benchmark lengths 41-500 (test)Follow96.1AccuracySRNN29.95647.12864.381.472May 16, 2026Evaluation ResultsMethodMethodLinksAccuracySRNNArchitecture=Stack-RNNArchitecture=Stack-RNN2026.0596.1TRNNArchitecture=Tape-RNNArchitecture=Tape-RNN2026.0595.4LSTM2026.0559.2RNN2026.0541.3PR-LSTM2026.0536.4TransformerArchitecture=encoder-onlyArchitecture=encoder-only2026.0532.5