Coin Flip
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Coin Flip
99.9Accuracy
27
Coin Flip
80.75Accuracy
10
Coin Flip OOD (test)
65.7Accuracy
6
Coin Flip (test)
98.6Accuracy
6
Coin Flip (OOD)
95.1pass@1
2
Coin Flip 4 times
91.4Accuracy (format-specific)
2