Agent Task on SciWorld (Suc@1, Suc@2, Suc@3)
98.4Success Rate @1PivoARL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PivoARLBackbone=Qwen3-4B2026.07 | 98.4 | 100 | 100 | |
| MetaRLBackbone=Qwen3-4B2026.07 | 94.5 | 97.6 | 98.4 | |
| GSPOBackbone=Qwen3-4B2026.07 | 89.8 | 94.5 | 96 | |
| DAPOBackbone=Qwen3-4B2026.07 | 83.5 | 94.5 | 98.4 | |
| SKillRLBackbone=Qwen3-4B2026.07 | 82.1 | 89 | 89.8 | |
| SimpleMem+GRPOBackbone=Qwen3-4B2026.07 | 81.7 | 90.2 | 92.6 | |
| Mem0+GRPOBackbone=Qwen3-4B2026.07 | 79.6 | 91.4 | 93.2 | |
| GiGPOBackbone=Qwen3-4B2026.07 | 78.9 | 86.7 | 89.8 | |
| GRPOBackbone=Qwen3-4B2026.07 | 75.8 | 82.8 | 86.7 | |
| Gemini-2.5-ProBackbone=Gemini-2.5-Pro2026.07 | 42.9 | 55.4 | 60.9 | |
| GPT-4oBackbone=GPT-4o2026.07 | 32.8 | 42.1 | 47.6 | |
| ReActBackbone=Qwen3-4B2026.07 | 9.4 | 12.5 | 12.5 | |
| ReflexionBackbone=Qwen3-4B2026.07 | 9.3 | 14.7 | 17.9 |