Open-ended generation on MMLU-Redux
4.22FDR (%)FDR search
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FDR searchModel=Qwen3-4B-Instruct-2507, Uncertainty Score=logits-based2025.10 | 4.22 | 29.87 | 25.11 | — | |
| Conformal LabelingModel=Qwen3-4B-Instruct-2507, Uncertainty Score=logits-based2025.10 | 4.84 | 33.62 | 28.46 | — | |
| Conformal LabelingModel=DeepSeek-R1-Distill-Qwen-32B, Uncertainty Score=logits-based2025.10 | 4.92 | 29.19 | 26.34 | — | |
| Conformal LabelingModel=Qwen3-4B-Thinking-2507, Uncertainty Score=logits-based2025.10 | 4.95 | 24.64 | 21.46 | — | |
| FDR searchModel=DeepSeek-R1-Distill-Qwen-32B, Uncertainty Score=logits-based2025.10 | 5.8 | 27.48 | 24.7 | — | |
| FDR searchModel=Qwen3-4B-Thinking-2507, Uncertainty Score=logits-based2025.10 | 5.85 | 23.77 | 20.62 | — | |
| SGRModel=Qwen3-4B-Thinking-2507, Uncertainty Score=logits-based2025.10 | 42.56 | 4.08 | 3.61 | — | |
| SGRModel=Qwen3-4B-Instruct-2507, Uncertainty Score=logits-based2025.10 | 43.17 | 9.06 | 7.71 | — | |
| SGRModel=DeepSeek-R1-Distill-Qwen-32B, Uncertainty Score=logits-based2025.10 | 51.35 | 6.89 | 6.3 | — | |
| AI onlyModel=Qwen3-4B-Instruct-25072025.10 | — | — | — | 20.17 | |
| AI onlyModel=Qwen3-4B-Thinking-25072025.10 | — | — | — | 20.79 | |
| AI onlyModel=DeepSeek-R1-Distill-Qwen-32B2025.10 | — | — | — | 15.07 |