# Web Navigation and Automation on WorkArena Held-out Tasks (test) Source: [Web Navigation and Automation on WorkArena Held-out Tasks (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:05:27.468Z Evaluation of agent performance on the WorkArena Held-out Tasks (test) split, focusing on success rate for web navigation and automation tasks. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Web Navigation and Automation | | Dataset (including any stated split) | WorkArena Held-out Tasks (test) | | Metric | Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Success Rate | Result date | Report paper | | --- | --- | --- | --- | | Claude-3.5-Sonnet | 70 | Not recorded | 68fa79d41e209131cea7f95b | | o1-Mini | 68.6 | Not recorded | 68fa79d41e209131cea7f95b | | Llama-3.1-405B-Instruct | 58.6 | Not recorded | 68fa79d41e209131cea7f95b | | GPT-4o | 55.7 | Not recorded | 68fa79d41e209131cea7f95b | | Llama-3.3-70B Instruct (Teacher) | 44 | Not recorded | 68fa79d41e209131cea7f95b | | Llama-3.1-70B-Instruct | 32.9 | Not recorded | 68fa79d41e209131cea7f95b | | Llama-3.1-8B SFT+RL (Ours) | 28.8 | Not recorded | 68fa79d41e209131cea7f95b | | GPT-4o-Mini | 28.6 | Not recorded | 68fa79d41e209131cea7f95b | | Qwen-2.5-72B Instruct (Teacher) | 27 | Not recorded | 68fa79d41e209131cea7f95b | | Llama-3.1-8B SFT (Ours) | 26.4 | Not recorded | 68fa79d41e209131cea7f95b | | Qwen-2.5-7B SFT+RL (Ours) | 25 | Not recorded | 68fa79d41e209131cea7f95b | | Qwen-2.5-7B SFT (Ours) | 21 | Not recorded | 68fa79d41e209131cea7f95b | | Llama-3.1-8B RL (Ours) | 11.5 | Not recorded | 68fa79d41e209131cea7f95b | | Qwen-2.5-7B Instruct (Student) | 10 | Not recorded | 68fa79d41e209131cea7f95b | | Qwen-2.5-7B RL (Ours) | 7 | Not recorded | 68fa79d41e209131cea7f95b | | Llama-3.1-8B Instruct (Student) | 4.2 | Not recorded | 68fa79d41e209131cea7f95b | ### Claude-3.5-Sonnet Success Rate: 70. Result ID: 699a631c5698665ec4eb31d8. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"Claude-3.5-Sonnet"}. This record does not assert independent reproduction. ### o1-Mini Success Rate: 68.6. Result ID: 699a631c5698665ec4eb31dc. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"o1-Mini"}. This record does not assert independent reproduction. ### Llama-3.1-405B-Instruct Success Rate: 58.6. Result ID: 699a631c5698665ec4eb31dd. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"Llama-3.1-405B"}. This record does not assert independent reproduction. ### GPT-4o Success Rate: 55.7. Result ID: 699a631c5698665ec4eb31d9. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"GPT-4o"}. This record does not assert independent reproduction. ### Llama-3.3-70B Instruct (Teacher) Success Rate: 44. Result ID: 699a631c5698665ec4eb31de. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"Llama-3.3-70B","Model Role":"Teacher"}. This record does not assert independent reproduction. ### Llama-3.1-70B-Instruct Success Rate: 32.9. Result ID: 699a631c5698665ec4eb31db. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"Llama-3.1-70B"}. This record does not assert independent reproduction. ### Llama-3.1-8B SFT+RL (Ours) Success Rate: 28.8. Result ID: 699a631c5698665ec4eb31e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone Model":"Llama-3.1-8B","Training Protocol":"SFT+RL"}. This record does not assert independent reproduction. ### GPT-4o-Mini Success Rate: 28.6. Result ID: 699a631c5698665ec4eb31da. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"GPT-4o-Mini"}. This record does not assert independent reproduction. ### Qwen-2.5-72B Instruct (Teacher) Success Rate: 27. Result ID: 699a631c5698665ec4eb31e3. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"Qwen-2.5-72B","Model Role":"Teacher"}. This record does not assert independent reproduction. ### Llama-3.1-8B SFT (Ours) Success Rate: 26.4. Result ID: 699a631c5698665ec4eb31e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone Model":"Llama-3.1-8B","Training Protocol":"SFT"}. This record does not assert independent reproduction. ### Qwen-2.5-7B SFT+RL (Ours) Success Rate: 25. Result ID: 699a631c5698665ec4eb31e7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone Model":"Qwen-2.5-7B","Training Protocol":"SFT+RL"}. This record does not assert independent reproduction. ### Qwen-2.5-7B SFT (Ours) Success Rate: 21. Result ID: 699a631c5698665ec4eb31e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone Model":"Qwen-2.5-7B","Training Protocol":"SFT"}. This record does not assert independent reproduction. ### Llama-3.1-8B RL (Ours) Success Rate: 11.5. Result ID: 699a631c5698665ec4eb31e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone Model":"Llama-3.1-8B","Training Protocol":"RL"}. This record does not assert independent reproduction. ### Qwen-2.5-7B Instruct (Student) Success Rate: 10. Result ID: 699a631c5698665ec4eb31e4. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"Qwen-2.5-7B","Model Role":"Student"}. This record does not assert independent reproduction. ### Qwen-2.5-7B RL (Ours) Success Rate: 7. Result ID: 699a631c5698665ec4eb31e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone Model":"Qwen-2.5-7B","Training Protocol":"RL"}. This record does not assert independent reproduction. ### Llama-3.1-8B Instruct (Student) Success Rate: 4.2. Result ID: 699a631c5698665ec4eb31df. [Reporting paper]() Recorded evaluation configuration: {"Backbone Model":"Llama-3.1-8B","Model Role":"Student"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.