Reliable Abstention on MIP and AbstentionBench insufficient-information
88.7DRJTS
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| JTSModel Backbone=DeepSeek-R1-Distill-Qwen-14B2026.05 | 88.7 | 88.5 | 99.8 | 349 | |
| JTSModel Backbone=Qwen3-30B-A3B-Thinking2026.05 | 72.9 | 72.4 | 99.3 | 342.9 | |
| PromptingModel Backbone=Qwen3-30B-A3B-Thinking2026.05 | 72.8 | 65.8 | 90.4 | 959.9 | |
| Plain RLModel Backbone=Qwen3-30B-A3B-Thinking2026.05 | 69.4 | 63.6 | 91.7 | 1,200 | |
| Plain RLModel Backbone=DeepSeek-R1-Distill-Qwen-14B2026.05 | 64.7 | 52.7 | 81.4 | 1,765.1 | |
| PromptingModel Backbone=DeepSeek-R1-Distill-Qwen-14B2026.05 | 56.5 | 52.7 | 93.3 | 714.6 | |
| BaseModel Backbone=Qwen3-30B-A3B-Thinking2026.05 | 52.9 | 21.1 | 40 | 2,839.4 | |
| BaseModel Backbone=DeepSeek-R1-Distill-Qwen-14B2026.05 | 45.3 | 18.6 | 41.1 | 2,605.9 |