Error Detection on HotpotQA (val)
100PrecisionIC-IDK
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| IC-IDKBase Model=Llama 3.1 8B2026.02 | 100 | 2 | 4 | 51 | |
| IC-IDKBase Model=Mistral 7B2026.02 | 95 | 10 | 18 | 54 | |
| AYSBase Model=Qwen3-32B2026.02 | 94 | 48 | 63 | 70 | |
| IC-IDKBase Model=Qwen3-32B2026.02 | 92 | 6 | 12 | 52 | |
| DBA-ABase Model=Llama 3.1 8B2026.02 | 91 | 77 | 83 | 77 | |
| AYSBase Model=Mistral 7B2026.02 | 90 | 46 | 60 | 64 | |
| IC-IDKBase Model=Qwen 2.5 72B2026.02 | 90 | 41 | 57 | 66 | |
| DBA-ABase Model=Mistral 7B2026.02 | 89 | 60 | 72 | 69 | |
| AYSBase Model=Llama 3.1 8B2026.02 | 89 | 52 | 66 | 66 | |
| Ensemble-ABase Model=Mistral 7B2026.02 | 88 | 78 | 83 | 71 | |
| DBA-IBase Model=Llama 3.1 8B2026.02 | 88 | 78 | 83 | 73 | |
| Ensemble-ABase Model=Llama 3.1 8B2026.02 | 87 | 85 | 86 | 74 | |
| IC-IDKBase Model=Gemini Flash2026.02 | 87 | 23 | 37 | 60 | |
| Ensemble-IBase Model=Llama 3.1 8B2026.02 | 86 | 89 | 88 | 73 | |
| DBA-ABase Model=Qwen3-32B2026.02 | 86 | 83 | 85 | 77 | |
| IC-IDKBase Model=Gemini Pro2026.02 | 86 | 20 | 32 | 59 | |
| DBA-IBase Model=Mistral 7B2026.02 | 85 | 55 | 67 | 62 | |
| Ensemble-IBase Model=Mistral 7B2026.02 | 85 | 72 | 78 | 65 | |
| DBA-IBase Model=Qwen3-32B2026.02 | 85 | 84 | 85 | 76 | |
| Ensemble-ABase Model=Qwen3-32B2026.02 | 85 | 89 | 87 | 77 | |
| Ensemble-IBase Model=Qwen3-32B2026.02 | 84 | 91 | 88 | 76 | |
| AYSBase Model=Qwen 2.5 72B2026.02 | 84 | 69 | 76 | 72 | |
| DBA-ABase Model=Qwen 2.5 72B2026.02 | 84 | 84 | 84 | 77 | |
| DBA-IBase Model=Qwen 2.5 72B2026.02 | 84 | 84 | 84 | 77 | |
| DBA-ABase Model=Gemini Pro2026.02 | 81 | 66 | 73 | 79 | |
| Ensemble-ABase Model=Qwen 2.5 72B2026.02 | 80 | 91 | 85 | 74 | |
| Ensemble-IBase Model=Qwen 2.5 72B2026.02 | 80 | 90 | 85 | 74 | |
| Ensemble-ABase Model=Gemini Pro2026.02 | 77 | 67 | 72 | 78 | |
| DBA-ABase Model=Gemini Flash2026.02 | 74 | 64 | 69 | 74 | |
| AYSBase Model=Gemini Pro2026.02 | 74 | 22 | 34 | 59 | |
| AYSBase Model=Gemini Flash2026.02 | 73 | 29 | 42 | 61 | |
| DBA-IBase Model=Gemini Pro2026.02 | 72 | 59 | 65 | 74 | |
| Ensemble-IBase Model=Gemini Pro2026.02 | 72 | 62 | 66 | 74 | |
| Ensemble-ABase Model=Gemini Flash2026.02 | 70 | 69 | 70 | 75 | |
| DBA-IBase Model=Gemini Flash2026.02 | 66 | 70 | 68 | 73 | |
| Ensemble-IBase Model=Gemini Flash2026.02 | 62 | 73 | 67 | 71 |