Semantic Parsing
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
95.7Execution Accuracy
6
Feb 26, 2026
77.9Template Accuracy
6
May 7, 2026
58.2Exact Match
6
Feb 26, 2026
3,770Exact Match
6
Feb 26, 2026
3,540Exact Match
6
Feb 26, 2026
98.9Exact Match
6
Feb 26, 2026
81.4Accuracy
6
Feb 26, 2026
57.1Query Accuracy
6
Feb 26, 2026
42.4Query Accuracy
6
Feb 26, 2026
82.7F1
6
Feb 26, 2026
92.9Accuracy
6
Feb 26, 2026
99.42Accuracy
5
Feb 26, 2026
0.743Calendar Score
5
Feb 26, 2026
89.5Accuracy
5
Feb 26, 2026
86.3Accuracy
5
Feb 26, 2026
89.6Accuracy
5
Feb 26, 2026
52.8F1 Score
5
Feb 27, 2026
52.8F1 Score
5
Feb 27, 2026
23F1
5
Feb 27, 2026
23.5F1 Score
5
Feb 27, 2026
80.52AMR Score (zho)
5
Feb 26, 2026
81.54AMR F1
5
Feb 26, 2026
79Accuracy
4
Feb 26, 2026
2,510Exact Match
4
Feb 26, 2026
97.2Execution Acc
4
Feb 26, 2026