Error Detection on Mintaka (val)
100PrecisionIC-IDK
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| IC-IDKBase Model=Qwen3-32B2026.02 | 100 | 10 | 17 | 55 | |
| DBA-ABase Model=Llama 3.1 8B2026.02 | 91 | 76 | 83 | 80 | |
| DBA-IBase Model=Llama 3.1 8B2026.02 | 91 | 73 | 81 | 79 | |
| IC-IDKBase Model=Mistral 7B2026.02 | 88 | 21 | 34 | 58 | |
| DBA-ABase Model=Qwen3-32B2026.02 | 88 | 83 | 86 | 83 | |
| DBA-IBase Model=Qwen3-32B2026.02 | 87 | 83 | 85 | 82 | |
| DBA-IBase Model=Qwen 2.5 72B2026.02 | 87 | 78 | 82 | 84 | |
| AYSBase Model=Llama 3.1 8B2026.02 | 86 | 55 | 67 | 68 | |
| DBA-ABase Model=Qwen 2.5 72B2026.02 | 86 | 77 | 81 | 83 | |
| DBA-ABase Model=Mistral 7B2026.02 | 85 | 38 | 52 | 64 | |
| Ensemble-ABase Model=Llama 3.1 8B2026.02 | 85 | 85 | 85 | 77 | |
| Ensemble-IBase Model=Llama 3.1 8B2026.02 | 85 | 85 | 85 | 77 | |
| AYSBase Model=Qwen3-32B2026.02 | 84 | 52 | 65 | 68 | |
| Ensemble-ABase Model=Qwen3-32B2026.02 | 84 | 92 | 88 | 82 | |
| Ensemble-ABase Model=Mistral 7B2026.02 | 82 | 57 | 67 | 69 | |
| IC-IDKBase Model=Llama 3.1 8B2026.02 | 82 | 7 | 13 | 52 | |
| Ensemble-IBase Model=Qwen3-32B2026.02 | 82 | 91 | 86 | 78 | |
| AYSBase Model=Mistral 7B2026.02 | 81 | 30 | 43 | 60 | |
| Ensemble-IBase Model=Mistral 7B2026.02 | 76 | 55 | 64 | 65 | |
| DBA-IBase Model=Mistral 7B2026.02 | 74 | 36 | 48 | 59 | |
| IC-IDKBase Model=Qwen 2.5 72B2026.02 | 74 | 26 | 39 | 59 | |
| Ensemble-ABase Model=Qwen 2.5 72B2026.02 | 74 | 90 | 81 | 80 | |
| Ensemble-IBase Model=Qwen 2.5 72B2026.02 | 72 | 89 | 79 | 78 | |
| IC-IDKBase Model=Gemini Pro2026.02 | 71 | 27 | 39 | 62 | |
| AYSBase Model=Qwen 2.5 72B2026.02 | 70 | 66 | 68 | 70 | |
| DBA-IBase Model=Gemini Pro2026.02 | 65 | 32 | 43 | 64 | |
| DBA-ABase Model=Gemini Flash2026.02 | 63 | 44 | 52 | 69 | |
| DBA-IBase Model=Gemini Flash2026.02 | 58 | 35 | 44 | 65 | |
| AYSBase Model=Gemini Flash2026.02 | 56 | 43 | 49 | 68 | |
| Ensemble-ABase Model=Gemini Flash2026.02 | 52 | 62 | 56 | 75 | |
| DBA-ABase Model=Gemini Pro2026.02 | 52 | 30 | 38 | 62 | |
| Ensemble-IBase Model=Gemini Flash2026.02 | 48 | 58 | 53 | 73 | |
| Ensemble-IBase Model=Gemini Pro2026.02 | 47 | 49 | 48 | 69 | |
| AYSBase Model=Gemini Pro2026.02 | 44 | 32 | 37 | 62 | |
| IC-IDKBase Model=Gemini Flash2026.02 | 43 | 12 | 19 | 54 | |
| Ensemble-ABase Model=Gemini Pro2026.02 | 42 | 47 | 44 | 67 |