Selective Prediction on HotpotQA
86.6Sel-AUCStructU+Self-ConsU (TrueSkill+PageRank)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| StructU+Self-ConsU (TrueSkill+PageRank)Model=Amazon Nova Premier, Scope=within2026.06 | 86.6 | 76.3 | |
| Self-ConsUModel=Claude 4.5 Sonnet2026.06 | 83.9 | 65.6 | |
| StructU+Self-ConsU (TrueSkill+PageRank)Model=DeepSeek R1, Scope=within2026.06 | 79.2 | 72.7 | |
| SemanticUModel=Qwen 3 32B2026.06 | 70.7 | 61.2 |