Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Formal-language benchmark dataset and benchmarks · SOTA2 Research

Research Datasets

Formal-language benchmark

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Formal-language benchmark lengths 41-500 (test)

99.4Accuracy

6

Formal-language benchmark lengths 41-500 (test)

57.8Accuracy (%)

6

Binary Multiplication

Formal-language benchmark lengths 41-500 (test)

58.5Accuracy (%)

6

Binary Addition

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Missing Duplicate

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Duplicate String

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Formal-language benchmark lengths 41-500 (test)

67.8Accuracy

6

Modular Arithmetic

Formal-language benchmark lengths 41-500 (test)

96.1Accuracy

6

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Stack Manipulation

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Cycle Navigation

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Modular Arithmetic (Simple)

Formal-language benchmark lengths 41-500 (test)

100Accuracy

6

Formal-language benchmark lengths 41-500 (test)

100Accuracy (%)

6

Popular tasks

Binary Addition Binary Multiplication Even Pairs Modular Arithmetic (Simple)Parity Check

Follow for updates

Join SOTA2 Contact