Web Agent on WorkArena L1
38.8Success RateWEASEL (10K steps)
Evaluation Results
| Method | Links | |
|---|---|---|
| WEASEL (10K steps)Model=Qwen3-8B, # Data=10K, # Epochs=2, Time=8.3 hr, Speed-up=10.7×2026.05 | 38.8 | |
| Qwen3-8BModel=Qwen3-8B2026.05 | 35.2 | |
| Pruning + LLM-Judge (10K steps)Model=Qwen3-8B, # Data=10K, # Epochs=2, Time=7.0 hr, Speed-up=12.6×2026.05 | 35.2 | |
| Pruning + Sampling (10K steps)Model=Qwen3-8B, # Data=10K, # Epochs=2, Time=7.0 hr, Speed-up=12.6×2026.05 | 33.9 | |
| Full (52K steps)Model=Qwen3-8B, # Data=52K, # Epochs=2, Time=88.5 hr, Speed-up=1.0×2026.05 | 33.3 | |
| Pruning (52K steps)Model=Qwen3-8B, # Data=52K, # Epochs=2, Time=44.0 hr, Speed-up=2.0×2026.05 | 15.5 | |
| Pruning (52K steps)Model=Qwen2.5-7B-Instruct, # Data=52K, # Epochs=4, Time=62.0 hr, Speed-up=2.2×2026.05 | 12.4 | |
| WEASEL (10K steps)Model=Qwen2.5-7B-Instruct, # Data=10K, # Epochs=4, Time=12.0 hr, Speed-up=11.3×2026.05 | 12.4 | |
| Full (52K steps)Model=Qwen2.5-7B-Instruct, # Data=52K, # Epochs=4, Time=136.0 hr, Speed-up=1.0×2026.05 | 12.1 | |
| Pruning + Sampling (10K steps)Model=Qwen2.5-7B-Instruct, # Data=10K, # Epochs=4, Time=12.0 hr, Speed-up=11.3×2026.05 | 9.8 | |
| Pruning + LLM-Judge (10K steps)Model=Qwen2.5-7B-Instruct, # Data=10K, # Epochs=4, Time=12.0 hr, Speed-up=11.3×2026.05 | 8.5 | |
| Qwen2.5-7B-InstructModel=Qwen2.5-7B-Instruct2026.05 | 4.8 | |
| Pruning + LLM-Judge (10K steps)Model=Gemma3-4B-IT, # Data=10K, # Epochs=2, Time=6.4 hr, Speed-up=12.5×2026.05 | 4.5 | |
| WEASEL (10K steps)Model=Gemma3-4B-IT, # Data=10K, # Epochs=2, Time=6.4 hr, Speed-up=12.5×2026.05 | 4.5 | |
| Gemma3-4B-ITModel=Gemma3-4B-IT2026.05 | 3.6 | |
| Full (52K steps)Model=Gemma3-4B-IT, # Data=52K, # Epochs=2, Time=80.0 hr, Speed-up=1.0×2026.05 | 3.3 | |
| Pruning (52K steps)Model=Gemma3-4B-IT, # Data=52K, # Epochs=2, Time=30.0 hr, Speed-up=2.7×2026.05 | 2.7 | |
| Pruning + Sampling (10K steps)Model=Gemma3-4B-IT, # Data=10K, # Epochs=2, Time=6.4 hr, Speed-up=12.5×2026.05 | 2.4 |