Error Detection on Mintaka
88F1 ScoreEnsemble-A
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Ensemble-AModel=Qwen3-8B2026.02 | 88 | 88 | 89 | 75 | |
| Ensemble-AModel=Qwen 8B2026.02 | 88 | — | — | 75 | |
| DBA-AModel=Qwen3-8B2026.02 | 87 | 92 | 82 | 79 | |
| DBA-AModel=Qwen 8B2026.02 | 87 | — | — | 79 | |
| Ensemble-IModel=Qwen3-8B2026.02 | 85 | 85 | 84 | 69 | |
| Ensemble-IModel=Qwen 8B2026.02 | 85 | — | — | 69 | |
| DBA-IModel=Qwen3-8B2026.02 | 81 | 90 | 74 | 74 | |
| DBA-IModel=Qwen 8B2026.02 | 81 | — | — | 74 | |
| DBA-IModel=Llama 3.3 70B2026.02 | 79 | 82 | 77 | 83 | |
| DBA-IModel=Llama 3.3 70B2026.02 | 79 | — | — | 83 | |
| Ensemble-IModel=Llama 3.3 70B2026.02 | 78 | 73 | 84 | 82 | |
| Ensemble-IModel=Llama 3.3 70B2026.02 | 78 | — | — | 82 | |
| DBA-AModel=Llama 3.3 70B2026.02 | 77 | 83 | 72 | 81 | |
| Ensemble-AModel=Llama 3.3 70B2026.02 | 77 | 73 | 82 | 82 | |
| DBA-AModel=Llama 3.3 70B2026.02 | 77 | — | — | 81 | |
| Ensemble-AModel=Llama 3.3 70B2026.02 | 77 | — | — | 82 | |
| AYSModel=Qwen3-8B2026.02 | 70 | 90 | 57 | 68 | |
| AYSModel=Qwen 8B2026.02 | 70 | — | — | 68 | |
| IC-IDKModel=Llama 3.3 70B2026.02 | 62 | 59 | 65 | 68 | |
| IC-IDKModel=Llama 3.3 70B2026.02 | 62 | — | — | 68 | |
| Ensemble-IModel=GPT 5.12026.02 | 49 | 43 | 59 | 73 | |
| AYSModel=Llama 3.3 70B2026.02 | 49 | 69 | 38 | 64 | |
| Ensemble-IModel=GPT 5.12026.02 | 49 | — | — | 73 | |
| AYSModel=Llama 3.3 70B2026.02 | 49 | — | — | 64 | |
| DBA-IModel=GPT 5.12026.02 | 48 | 64 | 39 | 68 | |
| DBA-IModel=GPT 5.12026.02 | 48 | — | — | 68 | |
| Ensemble-AModel=GPT 5.12026.02 | 46 | 42 | 51 | 70 | |
| Ensemble-AModel=GPT 5.12026.02 | 46 | — | — | 70 | |
| IC-IDKModel=Qwen3-8B2026.02 | 44 | 80 | 30 | 53 | |
| IC-IDKModel=Qwen 8B2026.02 | 44 | — | — | 53 | |
| DBA-AModel=GPT 5.12026.02 | 43 | 68 | 32 | 65 | |
| DBA-AModel=GPT 5.12026.02 | 43 | — | — | 65 | |
| AYSModel=GPT 5.12026.02 | 42 | 42 | 41 | 66 | |
| AYSModel=GPT 5.12026.02 | 42 | — | — | 66 | |
| IC-IDKModel=GPT 5.12026.02 | 31 | 37 | 27 | 60 | |
| IC-IDKModel=GPT 5.12026.02 | 31 | — | — | 60 |