List your company

ResearchFormerly WizWand

SParC

Benchmarks

TaskDatasetSOTA resultTrendResults

Dataset-level accuracy estimation

SParC to CoSQL

1.5MAE

54

Multi-turn Text-to-SQL

SParC In-domain

71.5Exact Match

29

Multi-turn Text-to-SQL

SparC (dev)

68.5QM EM

27

Context-dependent Text-to-SQL

SParC 1.0 (dev)

67.7Question Match

27

Multi-turn Text-to-SQL

SParC Out-of-domain

77.4Execution Accuracy (EX)

16

SParC

-0.43Kendall's Tau

12

Context-dependent Text-to-SQL

SParC (test)

65.7Question Match

12

Context-dependent Text-to-SQL

SParC 1.0 (test)

67.7Question Match

12

SPARC

8.5Speedup

8

Articulated-Body Algorithm (ABA)

SPARC

9.2Speedup

8

Composite Rigid Body Algorithm (CRBA)

SPARC

7.9Speedup

8

Recursive Newton-Euler Algorithm (RNEA)

SPARC

7.1Speedup

8

Jacobian Computation (Jac.)

SPARC

19Speedup

8

Forward Kinematics (FK)

SPARC

25Speedup

8

Conversational text-to-SQL

SParC (dev)

64.1Question Match

7

Semantic Parsing

SParC (dev)

42.4Query Accuracy

6

Radial acceleration relation modeling

SPARC database 2017

0.07wMSE

5

Rigid Body Dynamics

SPARC

17FK

4

Rigid Body Dynamics

SPARC 11 DOF

23FK

4

SParC

85.78Execution Accuracy

4

Language-to-SQL Parsing

Sparc (test)

47.9Exact Match (EM)

3

Language-to-SQL Parsing

Sparc (dev)

48.9EM

3

Multi-turn Text-to-SQL

SParC (ADVETA-ADD)

42.9EM

2

Multi-turn Text-to-SQL

SParC (ADVETA-RPL)

34.2Exact Match (EM)

2

Multi-turn Text-to-SQL

SParC original (dev)

50.7Exact Match (EM)

2