find-non-living-thing on ScienceWorld 20 unseen variants (test)
100ReturnEMPO2
Evaluation results
| Method | Links | |
|---|---|---|
| EMPO2Backbone=Qwen2.5-7B-Instruct, Learning Strategy=Online RL, Memory usage at test time=None2026.02 | 100 | |
| RetrospexBackbone=Qwen2.5-7B-Instruct, Learning Strategy=Offline RL, Memory usage at test time=None2026.02 | 89.1 | |
| NaiveBackbone=Qwen2.5-7B-Instruct, Learning Strategy=Naive, Memory usage at test time=None2026.02 | 35.9 | |
| GRPOBackbone=Qwen2.5-7B-Instruct, Learning Strategy=Online RL, Memory usage at test time=None2026.02 | 24.7 | |
| ReflexionBackbone=Qwen2.5-7B-Instruct, Learning Strategy=Non-Parametric, Memory usage at test time=None2026.02 | 4.8 |