Semantic Parsing
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
95.5Accuracy
33
Feb 26, 2026
95.3Accuracy
33
Feb 26, 2026
98.6Accuracy
33
Feb 26, 2026
93.6Exact Match Accuracy
32
Feb 27, 2026
89.5Accuracy
29
Feb 27, 2026
82.6Execution Accuracy
27
Feb 26, 2026
65.7Blocks Domain Score
26
Feb 26, 2026
0.939Accuracy
26
Feb 26, 2026
99Accuracy (Generalization)
25
Feb 26, 2026
99Exact Match Accuracy
23
Jul 1, 2026
88.9Program Accuracy
22
Feb 26, 2026
99.5Accuracy
22
Jul 1, 2026
95Exact Match Accuracy
22
Feb 26, 2026
73.5Accuracy
20
Feb 26, 2026
95.1Accuracy
19
Feb 26, 2026
42.21Accuracy
18
Feb 26, 2026
74.3Exact Match Accuracy
17
Feb 26, 2026
91.8Average Score
17
Feb 26, 2026
52.3Execution Accuracy (Best)
17
Feb 26, 2026
100Exact-match Accuracy
16
Feb 27, 2026
53Execution Accuracy (Best)
16
Feb 26, 2026
77.9Accuracy
15
Feb 26, 2026
0.853Accuracy
15
Feb 26, 2026
88.7Accuracy
15
Feb 26, 2026
45.19Accuracy
14
Feb 26, 2026