Question Answering on MuSiQue (Pearson r)
0.96Pearson rOC
Evaluation results
| Method | Links | |
|---|---|---|
| OCFormat=continuous2026.06 | 0.96 | |
| OCFormat=binarized at 0.5, Signal=paper’s primary2026.06 | 0.94 | |
| CoT-SCK=3, Format=continuous2026.06 | 0.45 | |
| naive direct-answer SCK=10, Mechanism=ablation2026.06 | 0.45 | |
| naive direct-answer SCK=3, Mechanism=ablation2026.06 | 0.45 | |
| −HK=10, Format=continuous2026.06 | 0.44 | |
| CoT-SCK=10, Format=continuous2026.06 | 0.43 | |
| P(True)Format=continuous, Models=9 models2026.06 | 0.42 | |
| Skywork-PRMMechanism=min over steps2026.06 | 0.38 | |
| decomposed-SCK=102026.06 | 0.23 | |
| RLHFlow-PRMMechanism=min over steps2026.06 | 0.18 |