List your company

ResearchFormerly WizWand

PISTOL

Benchmarks

TaskDatasetSOTA resultTrendResults

Fine-tuning for knowledge acquisition and abstention preservation

PISTOL

100FT Score

14

Contextual Question Answering

PISTOL (A_C)

98ROUGE-L

6

Direct Question Answering

PISTOL (A_C)

77.3ROUGE-L

6

Contextual Question Answering

PISTOL (A_B)

97.6ROUGE-L

6

Direct Question Answering

PISTOL (A_B)

79.1ROUGE-L

6