Short-form Question Answering on SimpleQA (F1, EM)
40F1 ScoreCheckRLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CheckRLMBackbone=QwQ-32B2026.07 | 40 | 30.4 | |
| CheckRLMBackbone=Qwen3-32B2026.07 | 39.1 | 30.6 | |
| CheckRLMBackbone=Qwen3-8B2026.07 | 35.7 | 28.6 | |
| Search-o1Backbone=QwQ-32B2026.07 | 35.4 | 27.4 | |
| Vanilla RAGBackbone=QwQ-32B2026.07 | 31.4 | 24.2 | |
| Self-RAGBackbone=QwQ-32B2026.07 | 31.1 | 24.8 | |
| RATBackbone=QwQ-32B2026.07 | 30.3 | 22.2 | |
| ReActBackbone=QwQ-32B2026.07 | 30.1 | 22.2 | |
| Vanilla RAGBackbone=Qwen3-8B2026.07 | 29.4 | 23 | |
| Vanilla RAGBackbone=Qwen3-32B2026.07 | 29.3 | 22.8 | |
| FLAREBackbone=QwQ-32B2026.07 | 24.1 | 17.4 | |
| Direct ReasoningBackbone=QwQ-32B2026.07 | 10.5 | 4.6 | |
| Direct ReasoningBackbone=Qwen3-32B2026.07 | 9.5 | 2.4 | |
| Direct ReasoningBackbone=Qwen3-8B2026.07 | 7.7 | 2.8 |