Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

SParC dataset and benchmarks · SOTA2 Research

Research Datasets

SParC

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Dataset-level accuracy estimation

SParC to CoSQL

1.5MAE

54

Multi-turn Text-to-SQL

SParC In-domain

71.5Exact Match

29

Multi-turn Text-to-SQL

SparC (dev)

68.5QM EM

27

Context-dependent Text-to-SQL

SParC 1.0 (dev)

67.7Question Match

27

Multi-turn Text-to-SQL

SParC Out-of-domain

77.4Execution Accuracy (EX)

16

SParC

-0.43Kendall's Tau

12

Context-dependent Text-to-SQL

SParC (test)

65.7Question Match

12

Context-dependent Text-to-SQL

SParC 1.0 (test)

67.7Question Match

12

SPARC

8.5Speedup

8

Articulated-Body Algorithm (ABA)

SPARC

9.2Speedup

8

Composite Rigid Body Algorithm (CRBA)

SPARC

7.9Speedup

8

Recursive Newton-Euler Algorithm (RNEA)

SPARC

7.1Speedup

8

Jacobian Computation (Jac.)

SPARC

19Speedup

8

Forward Kinematics (FK)

SPARC

25Speedup

8

Conversational text-to-SQL

SParC (dev)

64.1Question Match

7

Semantic Parsing

SParC (dev)

42.4Query Accuracy

6

Radial acceleration relation modeling

SPARC database 2017

0.07wMSE

5

Rigid Body Dynamics

SPARC

17FK

4

Rigid Body Dynamics

SPARC 11 DOF

23FK

4

SParC

85.78Execution Accuracy

4

Language-to-SQL Parsing

Sparc (test)

47.9Exact Match (EM)

3

Language-to-SQL Parsing

Sparc (dev)

48.9EM

3

Multi-turn Text-to-SQL

SParC (ADVETA-ADD)

42.9EM

2

Multi-turn Text-to-SQL

SParC (ADVETA-RPL)

34.2Exact Match (EM)

2

Multi-turn Text-to-SQL

SParC original (dev)

50.7Exact Match (EM)

2

Popular tasks

Multi-turn Text-to-SQL Context-dependent Text-to-SQL Text-to-SQL Language-to-SQL Parsing Rigid Body Dynamics

Follow for updates

Join SOTA2 Contact