Question Answering on HotpotQA (Pearson r)
0.94Pearson rCoT-SC
Evaluation results
| Method | Links | |
|---|---|---|
| CoT-SCK=3, Format=continuous2026.06 | 0.94 | |
| CoT-SCK=10, Format=continuous2026.06 | 0.93 | |
| OCFormat=binarized at 0.5, Signal=paper’s primary2026.06 | 0.92 | |
| OCFormat=continuous2026.06 | 0.92 | |
| decomposed-SCK=102026.06 | 0.67 | |
| naive direct-answer SCK=10, Mechanism=ablation2026.06 | 0.53 | |
| −HK=10, Format=continuous2026.06 | 0.52 | |
| naive direct-answer SCK=3, Mechanism=ablation2026.06 | 0.5 | |
| RLHFlow-PRMMechanism=min over steps2026.06 | 0.48 | |
| P(True)Format=continuous, Models=9 models2026.06 | 0.02 | |
| Skywork-PRMMechanism=min over steps2026.06 | 0.02 |