Reasoning Quality Correlation Analysis on PolitiFact
0.2895Somers' DMarODE
Evaluation results
| Method | Links | |
|---|---|---|
| MarODEPrompting Shots=1-shot2026.03 | 0.2895 | |
| MarODEPrompting Shots=2-shot2026.03 | 0.284 | |
| MarODE(αγ)Prompting Shots=1-shot2026.03 | 0.2799 | |
| MarODEPrompting Shots=4-shot2026.03 | 0.2792 | |
| MarODE(αγ)Prompting Shots=2-shot2026.03 | 0.2763 | |
| MarODE(αγ)Prompting Shots=4-shot2026.03 | 0.2714 | |
| MarODE(αβ)Prompting Shots=2-shot2026.03 | 0.2652 | |
| MarODE(αβ)Prompting Shots=4-shot2026.03 | 0.2639 | |
| MarODE(αβ)Prompting Shots=1-shot2026.03 | 0.2583 | |
| MarODE(βγ)Prompting Shots=1-shot2026.03 | 0.2444 | |
| MarODE_EVIDENCE(γ)Prompting Shots=1-shot2026.03 | 0.2398 | |
| MarODE(βγ)Prompting Shots=2-shot2026.03 | 0.2379 | |
| MarODE_EVIDENCE(γ)Prompting Shots=2-shot2026.03 | 0.2341 | |
| MarODE(βγ)Prompting Shots=4-shot2026.03 | 0.2322 | |
| MarODE_COHERENCE(α)Prompting Shots=4-shot2026.03 | 0.2296 | |
| MarODE_COHERENCE(α)Prompting Shots=2-shot2026.03 | 0.2284 | |
| MarODE_EVIDENCE(γ)Prompting Shots=4-shot2026.03 | 0.2279 | |
| MarODE_COHERENCE(α)Prompting Shots=1-shot2026.03 | 0.2165 | |
| ROSCOE-SSPrompting Shots=2-shot2026.03 | 0.135 | |
| ROSCOE-SSPrompting Shots=4-shot2026.03 | 0.1331 | |
| ROSCOE-SAPrompting Shots=4-shot2026.03 | 0.1281 | |
| ROSCOE-SSPrompting Shots=1-shot2026.03 | 0.1264 | |
| ROSCOE-SAPrompting Shots=2-shot2026.03 | 0.1152 | |
| ROSCOE-SAPrompting Shots=1-shot2026.03 | 0.1145 | |
| ROSCOE_MEANPrompting Shots=1-shot2026.03 | 0.0793 | |
| ROSCOE_MEANPrompting Shots=2-shot2026.03 | 0.0785 | |
| ROSCOE_MEANPrompting Shots=4-shot2026.03 | 0.0742 | |
| LLM_as_a_JudgePrompting Shots=1-shot2026.03 | 0.0516 | |
| LLM_as_a_JudgePrompting Shots=2-shot2026.03 | 0.0455 | |
| MarODE_QUALITY(β)Prompting Shots=4-shot2026.03 | 0.041 | |
| LLM_as_a_JudgePrompting Shots=4-shot2026.03 | 0.0407 | |
| MarODE_QUALITY(β)Prompting Shots=2-shot2026.03 | 0.0405 | |
| Local_and_GlobalPrompting Shots=2-shot2026.03 | 0.0379 | |
| MarODE_QUALITY(β)Prompting Shots=1-shot2026.03 | 0.0374 | |
| Local_and_GlobalPrompting Shots=4-shot2026.03 | 0.033 | |
| Local_and_GlobalPrompting Shots=1-shot2026.03 | 0.0296 | |
| ROSCOE-LIPrompting Shots=1-shot2026.03 | 0.0283 | |
| ROSCOE-LIPrompting Shots=2-shot2026.03 | 0.0256 | |
| ReCEvalPrompting Shots=1-shot2026.03 | 0.0253 | |
| ReCEvalPrompting Shots=2-shot2026.03 | 0.0243 | |
| ROSCOE-LIPrompting Shots=4-shot2026.03 | 0.02 | |
| ReCEvalPrompting Shots=4-shot2026.03 | 0.0177 | |
| ROSCOE-LCPrompting Shots=1-shot2026.03 | 0.0002 | |
| ROSCOE-LCPrompting Shots=2-shot2026.03 | -0.0047 | |
| ROSCOE-LCPrompting Shots=4-shot2026.03 | -0.0066 |