Error Detection on FRAMES (test)
97PrecisionAYS
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AYSBase Model=Llama 3.1 8B2026.02 | 97 | 40 | 57 | 64 | |
| IC-IDKBase Model=Llama 3.1 8B2026.02 | 97 | 12 | 21 | 54 | |
| IC-IDKBase Model=Qwen 2.5 72B2026.02 | 97 | 25 | 40 | 61 | |
| IC-IDKBase Model=Mistral 7B2026.02 | 96 | 37 | 53 | 63 | |
| DBA-ABase Model=Llama 3.1 8B2026.02 | 95 | 92 | 94 | 71 | |
| Ensemble-ABase Model=Llama 3.1 8B2026.02 | 95 | 94 | 94 | 70 | |
| DBA-IBase Model=Llama 3.1 8B2026.02 | 94 | 93 | 93 | 67 | |
| Ensemble-IBase Model=Llama 3.1 8B2026.02 | 94 | 96 | 95 | 65 | |
| DBA-ABase Model=Mistral 7B2026.02 | 93 | 87 | 90 | 69 | |
| AYSBase Model=Qwen3-32B2026.02 | 93 | 74 | 82 | 71 | |
| DBA-ABase Model=Qwen3-32B2026.02 | 93 | 89 | 91 | 73 | |
| DBA-IBase Model=Qwen 2.5 72B2026.02 | 93 | 89 | 91 | 79 | |
| Ensemble-ABase Model=Mistral 7B2026.02 | 92 | 89 | 91 | 66 | |
| IC-IDKBase Model=Qwen3-32B2026.02 | 92 | 10 | 17 | 52 | |
| DBA-IBase Model=Qwen3-32B2026.02 | 92 | 94 | 93 | 72 | |
| AYSBase Model=Mistral 7B2026.02 | 91 | 41 | 57 | 56 | |
| DBA-IBase Model=Mistral 7B2026.02 | 91 | 90 | 90 | 62 | |
| Ensemble-IBase Model=Mistral 7B2026.02 | 91 | 93 | 92 | 61 | |
| Ensemble-ABase Model=Qwen3-32B2026.02 | 91 | 96 | 93 | 68 | |
| Ensemble-IBase Model=Qwen3-32B2026.02 | 91 | 97 | 94 | 69 | |
| AYSBase Model=Qwen 2.5 72B2026.02 | 91 | 74 | 81 | 69 | |
| DBA-ABase Model=Qwen 2.5 72B2026.02 | 91 | 85 | 88 | 72 | |
| Ensemble-ABase Model=Qwen 2.5 72B2026.02 | 90 | 94 | 92 | 70 | |
| Ensemble-IBase Model=Qwen 2.5 72B2026.02 | 90 | 96 | 93 | 72 | |
| DBA-ABase Model=Gemini Flash2026.02 | 72 | 71 | 71 | 77 | |
| IC-IDKBase Model=Gemini Flash2026.02 | 70 | 12 | 21 | 55 | |
| DBA-IBase Model=Gemini Flash2026.02 | 69 | 74 | 71 | 76 | |
| DBA-ABase Model=Gemini Pro2026.02 | 69 | 52 | 59 | 71 | |
| AYSBase Model=Gemini Flash2026.02 | 68 | 50 | 57 | 68 | |
| Ensemble-ABase Model=Gemini Flash2026.02 | 67 | 86 | 75 | 79 | |
| IC-IDKBase Model=Gemini Pro2026.02 | 67 | 5 | 9 | 52 | |
| Ensemble-IBase Model=Gemini Flash2026.02 | 66 | 83 | 73 | 78 | |
| Ensemble-ABase Model=Gemini Pro2026.02 | 62 | 58 | 60 | 72 | |
| DBA-IBase Model=Gemini Pro2026.02 | 58 | 58 | 58 | 71 | |
| AYSBase Model=Gemini Pro2026.02 | 55 | 22 | 31 | 57 | |
| Ensemble-IBase Model=Gemini Pro2026.02 | 55 | 65 | 60 | 72 |