Question Answering on SciTrek Full context
48.8Exact Match AccuracyQwen3-235B-Thinking
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-235B-ThinkingTraining Strategy=Zero-shot2026.04 | 48.8 | |
| Qwen3-4B-Instruct (ProxyCoT-RL)Training Strategy=ProxyCoT-RL2026.04 | 46.5 | |
| Qwen3-235B-InstructTraining Strategy=Zero-shot2026.04 | 45.2 | |
| Gemma3-4B-IT (ProxyCoT-RL)Training Strategy=ProxyCoT-RL2026.04 | 43.7 | |
| Qwen3-4B-Instruct (ProxyCoT-ZS)Training Strategy=ProxyCoT-ZS2026.04 | 38.8 | |
| Gemma3-4B-ITTraining Strategy=SFT on C, CoT*2026.04 | 36.9 | |
| Gemma3-4B-IT (ProxyCoT-ZS)Training Strategy=ProxyCoT-ZS2026.04 | 36.5 | |
| Qwen3-4B-InstructTraining Strategy=RLVR on C2026.04 | 32.9 | |
| Qwen3-4B-InstructTraining Strategy=SFT on C, CoT*2026.04 | 31.6 | |
| Qwen3-4B-InstructTraining Strategy=Zero-shot2026.04 | 30.8 | |
| Qwen3-4B-InstructTraining Strategy=SFT on C2026.04 | 19.5 | |
| Gemma3-4B-ITTraining Strategy=SFT on C2026.04 | 12.7 | |
| Gemma3-4B-ITTraining Strategy=RLVR on C2026.04 | 5.5 | |
| Gemma3-4B-ITTraining Strategy=Zero-shot2026.04 | 3 |