List your company

ResearchFormerly WizWand

ToTTo

Benchmarks

TaskDatasetSOTA resultTrendResults

Data-to-Text Generation

ToTTo

52.28BLEU

18

Loosely controlled table-to-text generation

ToTTO Logic2Text-style (test)

52.7BLEU

15

Table-to-Text Generation

ToTTo Over (test)

0.364BLEURT

15

Table-to-Text Generation

ToTTo Non (test)

0.116BLEURT Score

15

Table-to-Text Generation

ToTTo All (dev)

0.24BLEURT

15

Table-to-Text Generation

ToTTo (test)

0.24BLEURT Score

15

Data-to-Text Generation

ToTTo full (test)

50.8BLEU

12

Loosely controlled table-to-text generation

ToTTO Logic2Text-style (dev)

46.2BLEU

10

Tightly controlled table-to-text generation

ToTTO official (TestN)

48.7BLEU

10

Cell-Level Attribution

ToTTo

74.2Precision

6

Column-Level Attribution

ToTTo

92.7Precision

6

Row-Level Attribution

ToTTo

77Precision

6

Cell-level attribution

ToTTo (gold set)

56.89Precision

6

Open-ended table-to-text generation

ToTTO Logic2Text-style (test)

0.247BLEU

5

Open-ended table-to-text generation

ToTTO Logic2Text-style (TestO)

28.9BLEU

5

Open-ended table-to-text generation

ToTTO Logic2Text-style (TestN)

20.5BLEU

5

Tightly controlled table-to-text generation

ToTTO official (test)

56.7BLEU

5

Tightly controlled table-to-text generation

ToTTO official (dev)

49BLEU

5

Data-to-text generation

Totto Non-overlap (dev)

41.5BLEU Score

5

Data-to-text generation

Totto All (dev)

49.2BLEU Score

5

Table-to-text generation

ToTTo (human evaluation)

89TControl

4

Table-to-Text Generation

ToTTo (dev)

48.95BLEU

4

Data-to-text generation

Totto All (test)

49.5BLEU

3

Table-to-text generation

ToTTo Non-Overlap (test)

41.4BLEU

3

ToTTo (test)

14.06Accuracy

1