Answerability Prediction on MATH n=50 (matched pairs)
84.1AUCGeometry (own_dist)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Geometry (own_dist)Model=Llama, Protocol=pre-generation, zero samples2026.05 | 84.1 | 71.4 | |
| Geometry (own_dist)Model=Mistral, Protocol=pre-generation, zero samples2026.05 | 82.6 | 71.4 | |
| Geometry (own_dist)Model=Qwen, Protocol=pre-generation, zero samples2026.05 | 78.2 | 69.4 | |
| Refusal (Keyword Classifier)Model=Mistral, Protocol=post-generation, single output2026.05 | 73 | 63 | |
| Refusal (Keyword Classifier)Model=Qwen, Protocol=post-generation, single output2026.05 | 71 | 59.2 | |
| Refusal (Keyword Classifier)Model=Llama, Protocol=post-generation, single output2026.05 | 63 | 41.3 | |
| SC (Self-Consistency)Model=Llama, Protocol=post-generation, 5 samples2026.05 | 62.4 | — | |
| SC (Self-Consistency)Model=Mistral, Protocol=post-generation, 5 samples2026.05 | 52.4 | — | |
| SC (Self-Consistency)Model=Qwen, Protocol=post-generation, 5 samples2026.05 | 29.6 | — |