Question Answering on popQA Extreme
24.96F1 ScoreOpenDecoder
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OpenDecoderBackbone=Qwen-2.5-3B-Instruct2026.01 | 24.96 | 22.02 | |
| RbFTBackbone=Qwen-2.5-3B-Instruct2026.01 | 21.59 | 20.8 | |
| Vanilla SFTBackbone=Qwen-2.5-3B-Instruct2026.01 | 19.27 | 18.37 | |
| AstuteRAGBackbone=Qwen-2.5-3B-Instruct2026.01 | 15.74 | 12.8 | |
| InstructRAGBackbone=Qwen-2.5-3B-Instruct2026.01 | 1.62 | 0.7 | |
| Vanilla RAGBackbone=Qwen-2.5-3B-Instruct2026.01 | 0.98 | 11.87 | |
| RobustRAGBackbone=Qwen-2.5-3B-Instruct2026.01 | 0.39 | 1.2 |