Question Answering with Abstention on TriviaQA
47BASTask Calibration
Evaluation Results
| Method | Links | |
|---|---|---|
| Task CalibrationModel=Gemma-3-12B, Decoding Strategy=Ours2026.05 | 47 | |
| AncestralModel=Qwen3-30B-A3B, Decoding Strategy=Ancestral2026.05 | 47 | |
| BeamModel=Qwen3-30B-A3B, Decoding Strategy=Beam2026.05 | 47 | |
| AncestralModel=Gemma-3-12B, Decoding Strategy=Ancestral2026.05 | 46 | |
| ContrastiveModel=Gemma-3-12B, Decoding Strategy=Contrastive2026.05 | 46 | |
| ContrastiveModel=Qwen3-30B-A3B, Decoding Strategy=Contrastive2026.05 | 46 | |
| GreedyModel=Qwen3-30B-A3B, Decoding Strategy=Greedy2026.05 | 46 | |
| MBRModel=Qwen3-30B-A3B, Decoding Strategy=MBR2026.05 | 46 | |
| Task CalibrationModel=Qwen3-30B-A3B, Decoding Strategy=Ours2026.05 | 46 | |
| BeamModel=Gemma-3-12B, Decoding Strategy=Beam2026.05 | 45 | |
| GreedyModel=Gemma-3-12B, Decoding Strategy=Greedy2026.05 | 45 | |
| MBRModel=Gemma-3-12B, Decoding Strategy=MBR2026.05 | 44 | |
| Task CalibrationModel=Gemma-3-4B, Decoding Strategy=Ours2026.05 | 22 | |
| AncestralModel=Gemma-3-4B, Decoding Strategy=Ancestral2026.05 | 21 | |
| Task CalibrationModel=Qwen-3-4B, Decoding Strategy=Ours2026.05 | 21 | |
| BeamModel=Gemma-3-4B, Decoding Strategy=Beam2026.05 | 20 | |
| ContrastiveModel=Gemma-3-4B, Decoding Strategy=Contrastive2026.05 | 19 | |
| GreedyModel=Gemma-3-4B, Decoding Strategy=Greedy2026.05 | 19 | |
| AncestralModel=Qwen-3-4B, Decoding Strategy=Ancestral2026.05 | 19 | |
| BeamModel=Qwen-3-4B, Decoding Strategy=Beam2026.05 | 19 | |
| ContrastiveModel=Qwen-3-4B, Decoding Strategy=Contrastive2026.05 | 19 | |
| MBRModel=Gemma-3-4B, Decoding Strategy=MBR2026.05 | 18 | |
| GreedyModel=Qwen-3-4B, Decoding Strategy=Greedy2026.05 | 18 | |
| MBRModel=Qwen-3-4B, Decoding Strategy=MBR2026.05 | 16 |