Mean Reward on WebShop
63.7Mean RewardAgentDiet
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AgentDietBackbone=gpt-5-mini, Inference Protocol=LLM-call per step2026.05 | 63.7 | 114 | |
| LongLinguaBackbone=gpt-5-mini, Inference Protocol=Inference-free2026.05 | 62.3 | 111 | |
| ObsMaskBackbone=qwen3.5-flash, Inference Protocol=Inference-free2026.05 | 59.4 | 120 | |
| AgentDietBackbone=qwen3.5-flash, Inference Protocol=LLM-call per step2026.05 | 56.7 | 114 | |
| Floor-K2Backbone=qwen3.5-flash, Inference Protocol=Inference-free2026.05 | 56.1 | 112 | |
| TruncBackbone=qwen3.5-flash, Inference Protocol=Inference-free2026.05 | 53.8 | 108 | |
| ACONBackbone=qwen3.5-flash, Inference Protocol=LLM-call per step2026.05 | 53.3 | 107 | |
| Floor-K2Backbone=gpt-5-mini, Inference Protocol=Inference-free2026.05 | 50.9 | 106 | |
| ObsMaskBackbone=gpt-5-mini, Inference Protocol=Inference-free2026.05 | 50.7 | 90 | |
| NO-COMPBackbone=qwen3.5-flash, Inference Protocol=Inference-free2026.05 | 49.9 | — | |
| HiAgentBackbone=qwen3.5-flash, Inference Protocol=LLM-call per step2026.05 | 48.4 | 98 | |
| NO-COMPBackbone=gpt-5-mini, Inference Protocol=Inference-free2026.05 | 47.9 | — | |
| AGORABackbone=qwen3.5-flash, Inference Protocol=Inference-free2026.05 | 46.8 | 94 | |
| AGORABackbone=gpt-5-mini, Inference Protocol=Inference-free2026.05 | 43.1 | 90 | |
| HiAgentBackbone=gpt-5-mini, Inference Protocol=LLM-call per step2026.05 | 40.8 | 73 | |
| LongLinguaBackbone=qwen3.5-flash, Inference Protocol=Inference-free2026.05 | 37.2 | 75 | |
| TruncBackbone=gpt-5-mini, Inference Protocol=Inference-free2026.05 | 35.9 | 75 | |
| ObsMaskBackbone=gpt-4o-mini, Inference Protocol=Inference-free2026.05 | 31.2 | 223 | |
| Floor-K2Backbone=gpt-4o-mini, Inference Protocol=Inference-free2026.05 | 30.1 | 103 | |
| NO-COMPBackbone=gpt-4o-mini, Inference Protocol=Inference-free2026.05 | 29.3 | — | |
| HiAgentBackbone=gpt-4o-mini, Inference Protocol=LLM-call per step2026.05 | 27.8 | 198 | |
| TruncBackbone=gpt-4o-mini, Inference Protocol=Inference-free2026.05 | 26.7 | 91 | |
| AGORABackbone=gpt-4o-mini, Inference Protocol=Inference-free2026.05 | 26.6 | 91 | |
| ACONBackbone=gpt-4o-mini, Inference Protocol=LLM-call per step2026.05 | 22.7 | 162 | |
| AgentDietBackbone=gpt-4o-mini, Inference Protocol=LLM-call per step2026.05 | 21.3 | 152 | |
| LongLinguaBackbone=gpt-4o-mini, Inference Protocol=Inference-free2026.05 | 11.3 | 81 | |
| ACONBackbone=gpt-5-mini, Inference Protocol=LLM-call per step2026.05 | 3.3 | 6 | |
| SelCtxBackbone=qwen3.5-flash, Inference Protocol=Inference-free2026.05 | 0 | 0 | |
| SelCtxBackbone=gpt-4o-mini, Inference Protocol=Inference-free2026.05 | 0 | 0 | |
| SelCtxBackbone=gpt-5-mini, Inference Protocol=Inference-free2026.05 | 0 | 0 |