chemistry-mix-paint-tertiary-color on ScienceWorld 20 unseen variants (test)
42.6ReturnGRPO
Evaluation results
| Method | Links | |
|---|---|---|
| GRPOBackbone=Qwen2.5-7B-Instruct, Learning Strategy=Online RL, Memory usage at test time=None2026.02 | 42.6 | |
| EMPO2Backbone=Qwen2.5-7B-Instruct, Learning Strategy=Online RL, Memory usage at test time=None2026.02 | 39.2 | |
| ReflexionBackbone=Qwen2.5-7B-Instruct, Learning Strategy=Non-Parametric, Memory usage at test time=None2026.02 | 36.9 | |
| NaiveBackbone=Qwen2.5-7B-Instruct, Learning Strategy=Naive, Memory usage at test time=None2026.02 | 33.9 | |
| RetrospexBackbone=Qwen2.5-7B-Instruct, Learning Strategy=Offline RL, Memory usage at test time=None2026.02 | 7.6 |