Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

CREAK dataset and benchmarks · SOTA2 Research

Research Datasets

CREAK

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Fact Verification

Creak WikiData (test)

97.45Hits@1

17

Commonsense Fact Verification

CREAK (test)

88.6Accuracy

17

Knowledge Base Question Answering

Creak WikiData (test)

91.82Hits@1

14

False Premise Detection

CREAK

92.8TP (%)

12

Fact Verification

CREAK Far OOD

93.2Accuracy

10

Structural Reasoning

CREAK

86.5Accuracy

9

Fact Verification

Creak

0.956Accuracy

8

Commonsense Fact Verification

CREAK Contrast Set (contra)

92.2Accuracy

4

Popular tasks

Fact Verification Commonsense Fact Verification Knowledge Base Question Answering False Premise Detection Structural Reasoning

Follow for updates

Join SOTA2 Contact