Web Action Generation Efficiency on Mind2Web Cross-Task
378.2Time to ProcedureDuSAR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DuSARModel=Llama3.1-70B2025.12 | 378.2 | 10.7 | |
| DuSARModel=Llama3.1-8B2025.12 | 381.9 | 16.2 | |
| DuSARModel=Gemma3-12B2025.12 | 393.4 | 11.3 | |
| DuSARModel=Llama2-7B2025.12 | 539.5 | 80.5 | |
| ReActModel=Llama3.1-70B2025.12 | 1,482.7 | 437.1 | |
| SynapseModel=Llama3.1-70B2025.12 | 1,545.8 | 18.5 | |
| ReActModel=Gemma3-12B2025.12 | 1,571.2 | 12.5 | |
| ReActModel=Llama3.1-8B2025.12 | 1,728 | 626.3 | |
| SynapseModel=Gemma3-12B2025.12 | 1,777.2 | 18.5 | |
| SynapseModel=Llama3.1-8B2025.12 | 1,909.2 | 20.5 | |
| ReActModel=Llama2-7B2025.12 | 1,914.8 | 111.1 | |
| SynapseModel=Llama2-7B2025.12 | 2,124.5 | 36.2 | |
| TRADModel=Llama3.1-70B2025.12 | 3,244.1 | 30 | |
| TRADModel=Llama3.1-8B2025.12 | 3,302 | 657.8 | |
| TRADModel=Gemma3-12B2025.12 | 3,369.2 | 19.4 | |
| TRADModel=Llama2-7B2025.12 | 3,589.9 | 109.3 |