Claim-level specificity control on HotpotQA pilot
630Claims EmittedOracle CSS
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Oracle CSSPolicy=Oracle, Model=Claude Sonnet 4.6, Ex.=1402026.04 | 630 | 648 | 100 | 95.99 | 95.99 | 95.99 | |
| Calibrated CSSPolicy=Calibrated, Model=Claude Sonnet 4.6, Ex.=1402026.04 | 628 | 648 | 99.04 | 94.75 | 93.95 | 93.02 | |
| Uncalibrated CSSPolicy=Uncalibrated, Model=Claude Sonnet 4.6, Ex.=1402026.04 | 622 | 648 | 99.36 | 71.91 | 71.42 | 70.8 | |
| Calibrated CSSPolicy=Calibrated, Model=GPT-5.4, Ex.=1402026.04 | 429 | 470 | 97.9 | 90 | 88.09 | 86.17 | |
| Oracle CSSPolicy=Oracle, Model=GPT-5.4, Ex.=1402026.04 | 426 | 470 | 100 | 89.96 | 89.96 | 89.96 | |
| Uncalibrated CSSPolicy=Uncalibrated, Model=GPT-5.4, Ex.=1402026.04 | 409 | 470 | 98.29 | 62.09 | 61.11 | 59.62 |