Question Answering on DROP (Pearson r)
0.89Pearson rCoT-SC
Evaluation Results
| Method | Links | |
|---|---|---|
| CoT-SCK=3, Format=continuous2026.06 | 0.89 | |
| CoT-SCK=10, Format=continuous2026.06 | 0.87 | |
| OCFormat=binarized at 0.5, Signal=paper’s primary2026.06 | 0.86 | |
| OCFormat=continuous2026.06 | 0.85 | |
| Skywork-PRMMechanism=min over steps2026.06 | 0.82 | |
| naive direct-answer SCK=3, Mechanism=ablation2026.06 | 0.62 | |
| −HK=10, Format=continuous2026.06 | 0.61 | |
| naive direct-answer SCK=10, Mechanism=ablation2026.06 | 0.61 | |
| RLHFlow-PRMMechanism=min over steps2026.06 | 0.31 | |
| P(True)Format=continuous, Models=9 models2026.06 | 0.21 | |
| decomposed-SCK=102026.06 | 0.21 |