Semantic Parsing
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
91.1Accuracy
14
Feb 26, 2026
50.43Accuracy
14
Feb 26, 2026
80.5Primary Labeled F-score
14
Feb 26, 2026
72.9Accuracy
13
Feb 26, 2026
84Accuracy
13
Feb 26, 2026
82.8Exact Match Acc
12
Feb 26, 2026
80.2Exact Match Accuracy
12
Feb 27, 2026
80.8Exact Match Accuracy
12
Feb 27, 2026
0.674Exact-match Accuracy
12
Feb 27, 2026
100Exact-match Accuracy
11
Feb 27, 2026
75.5Exact Match Accuracy
11
Feb 26, 2026
93.58Properties F1
11
Feb 26, 2026
3.4Generalization Error (G(W))
10
Jun 15, 2026
100PP Recursion (Depth 3)
10
Jul 3, 2026
50.7mIoU
10
Feb 26, 2026
89.3Accuracy
10
Feb 26, 2026
88.3F1 Score
10
Feb 26, 2026
40.2Query Acc
10
Feb 26, 2026
94.3MCD1 Accuracy
9
Feb 26, 2026
86.5F1 Score
9
Feb 26, 2026
74.4Program Acc
8
Feb 26, 2026
83.6Program Accuracy
8
Feb 26, 2026
95.7Program Accuracy
8
Feb 26, 2026
83.2Exact Match Accuracy
8
Feb 26, 2026
40.7Exact Match Acc
8
Feb 26, 2026