Coinflip
Benchmarks
TaskDatasetSOTA resultTrendResults
Coinflip 4
99.5Accuracy
10
CoinFlip (unseen)
51.8Baseline Score
9
CoinFlip
100Calibrated Accuracy
8
Coinflip OOD: 4
90.2Accuracy
3
Coinflip OOD: 3
98.6Accuracy
3
CoinFlip (unseen)
52.2Baseline Consistency Score
3
Coinflip OOD: 4 (test)
—Accuracy
0
Coinflip OOD: 3 (test)
—Accuracy
0