General Reasoning on GPQA (multi@5 accuracy)
72.7multi@5 AccuracyDRIFT-5turn
Evaluation Results
| Method | Links | |
|---|---|---|
| DRIFT-5turnBackbone=Qwen2.5-3B-Instruct, Protocol=Ours, Max turns=52026.05 | 72.7 | |
| UFO-5turnBackbone=Qwen2.5-3B-Instruct, Protocol=Multi-turn baselines (Online), Max turns=52026.05 | 71.2 | |
| SCoRe-2turnBackbone=Qwen2.5-3B-Instruct, Protocol=Multi-turn baselines (Online), Max turns=22026.05 | 63.2 | |
| UFO-5turnBackbone=Llama3.1-8B-Instruct, Protocol=Multi-turn baselines (Online), Max turns=52026.05 | 61.6 | |
| DRIFT-5turnBackbone=Llama3.1-8B-Instruct, Protocol=Ours, Max turns=52026.05 | 60.1 | |
| STaR-2turnBackbone=Qwen2.5-3B-Instruct, Protocol=Multi-turn baselines (Offline), Max turns=22026.05 | 58.6 | |
| SFT-5turnBackbone=Qwen2.5-3B-Instruct, Protocol=Multi-turn baselines (Offline), Max turns=52026.05 | 58 | |
| STaR-2turnBackbone=Llama3.1-8B-Instruct, Protocol=Multi-turn baselines (Offline), Max turns=22026.05 | 55.7 | |
| SCoRe-2turnBackbone=Llama3.1-8B-Instruct, Protocol=Multi-turn baselines (Online), Max turns=22026.05 | 54.8 | |
| SFTBackbone=Qwen2.5-3B-Instruct, Protocol=Single-turn baselines2026.05 | 51 | |
| PPOBackbone=Llama3.1-8B-Instruct, Protocol=Single-turn baselines2026.05 | 50.2 | |
| SFT-5turnBackbone=Llama3.1-8B-Instruct, Protocol=Multi-turn baselines (Offline), Max turns=52026.05 | 48.5 | |
| BaseBackbone=Qwen2.5-3B-Instruct, Protocol=Single-turn baselines2026.05 | 47.9 | |
| SFTBackbone=Llama3.1-8B-Instruct, Protocol=Single-turn baselines2026.05 | 46.4 | |
| PPOBackbone=Qwen2.5-3B-Instruct, Protocol=Single-turn baselines2026.05 | 45.1 | |
| BaseBackbone=Llama3.1-8B-Instruct, Protocol=Single-turn baselines2026.05 | 44.9 |