Question Answering on SciTrek (Proxy Context)
88.5Exact MatchQwen3-4B-Instruct (ProxyCoT-RL)
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-4B-Instruct (ProxyCoT-RL)Training Strategy=ProxyCoT-RL2026.04 | 88.5 | |
| Qwen3-235B-ThinkingTraining Strategy=Zero-shot2026.04 | 85.6 | |
| Qwen3-235B-InstructTraining Strategy=Zero-shot2026.04 | 72.7 | |
| Gemma3-4B-IT (ProxyCoT-RL)Training Strategy=ProxyCoT-RL2026.04 | 69.8 | |
| Qwen3-4B-Instruct (ProxyCoT-ZS)Training Strategy=ProxyCoT-ZS2026.04 | 67.8 | |
| Qwen3-4B-InstructTraining Strategy=Zero-shot2026.04 | 67.2 | |
| Qwen3-4B-InstructTraining Strategy=RLVR on C2026.04 | 66.1 | |
| Gemma3-4B-IT (ProxyCoT-ZS)Training Strategy=ProxyCoT-ZS2026.04 | 64.2 | |
| Gemma3-4B-ITTraining Strategy=SFT on C, CoT*2026.04 | 53.1 | |
| Qwen3-4B-InstructTraining Strategy=SFT on C, CoT*2026.04 | 45.8 | |
| Gemma3-4B-ITTraining Strategy=RLVR on C2026.04 | 39.9 | |
| Qwen3-4B-InstructTraining Strategy=SFT on C2026.04 | 39 | |
| Gemma3-4B-ITTraining Strategy=Zero-shot2026.04 | 34.2 | |
| Gemma3-4B-ITTraining Strategy=SFT on C2026.04 | 19.1 |