# Web Task Reasoning on GAIA (test) Source: [Web Task Reasoning on GAIA (test)]() Collection index: [llms.txt]() Data updated: 2026-05-22T08:20:55.597Z Evaluation of Web Task Reasoning capabilities on the test split of the GAIA dataset, measured using Pass@1. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Web Task Reasoning | | Dataset (including any stated split) | GAIA (test) | | Metric | Pass@1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 25 of 25 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Pass@1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Pass@1 | Result date | Report paper | | --- | --- | --- | --- | | MiroThinker-v1.5 | 84.5 | Not recorded | 6a0fe32ef984739ed6739f26 | | GPT-5.4-xhigh | 83.5 | Not recorded | 6a0fe32ef984739ed6739f26 | | DeepSeek-V3.2 | 81.3 | Not recorded | 6a0fe32ef984739ed6739f26 | | SR2AM-v1.0-30B | 76 | Not recorded | 6a0fe32ef984739ed6739f26 | | Kimi-K2.5 | 73.5 | Not recorded | 6a0fe32ef984739ed6739f26 | | Tongyi-DeepResearch | 67.7 | Not recorded | 6a0fe32ef984739ed6739f26 | | GLM-4.6 | 60.9 | Not recorded | 6a0fe32ef984739ed6739f26 | | GPT-OSS-120B-high | 54.9 | Not recorded | 6a0fe32ef984739ed6739f26 | | ASearcher-Web-QWQ-v2 | 50.5 | Not recorded | 6a0fe32ef984739ed6739f26 | | Qwen3-235B | 50 | Not recorded | 6a0fe32ef984739ed6739f26 | | WebSailor-32B | 46.1 | Not recorded | 6a0fe32ef984739ed6739f26 | | SR2AM-v0.1-8B | 46.1 | Not recorded | 6a0fe32ef984739ed6739f26 | | WebExplorer-8B | 43.5 | Not recorded | 6a0fe32ef984739ed6739f26 | | GPT-5.4-xhigh | 42 | Not recorded | 6a0fe32ef984739ed6739f26 | | A2FM | 38.8 | Not recorded | 6a0fe32ef984739ed6739f26 | | DeepSeek-V3.2 | 37.1 | Not recorded | 6a0fe32ef984739ed6739f26 | | Qwen3-30B-A3B | 36.9 | Not recorded | 6a0fe32ef984739ed6739f26 | | WebSailor-7B | 35.2 | Not recorded | 6a0fe32ef984739ed6739f26 | | K2-Think-V2-high | 27.4 | Not recorded | 6a0fe32ef984739ed6739f26 | | AFM-Web-7B-RL | 22.6 | Not recorded | 6a0fe32ef984739ed6739f26 | | ASearcher-Web-7B | 20.4 | Not recorded | 6a0fe32ef984739ed6739f26 | | Qwen3-30B-A3B | 18.9 | Not recorded | 6a0fe32ef984739ed6739f26 | | SimpleTIR-32B | 11.9 | Not recorded | 6a0fe32ef984739ed6739f26 | | SimpleTIR-7B | 8.7 | Not recorded | 6a0fe32ef984739ed6739f26 | | AFM-Code-7B-RL | 7.8 | Not recorded | 6a0fe32ef984739ed6739f26 | ### MiroThinker-v1.5 Pass@1: 84.5. Result ID: 6a1011e2fbc373592c08fab5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"11295.2","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### GPT-5.4-xhigh Pass@1: 83.5. Result ID: 6a1011e2fbc373592c08faac. [Reporting paper]() Recorded evaluation configuration: {"Size":"—","# Reas. Tokens":"4821.8","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### DeepSeek-V3.2 Pass@1: 81.3. Result ID: 6a1011e2fbc373592c08faaa. [Reporting paper]() Recorded evaluation configuration: {"Size":"685B","# Reas. Tokens":"3011.5","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### SR2AM-v1.0-30B Pass@1: 76. Result ID: 6a1011e2fbc373592c08faba. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"5517.7","Reasoning Paradigm":"Self-Regulated Simulative Reasoning"}. This record does not assert independent reproduction. ### Kimi-K2.5 Pass@1: 73.5. Result ID: 6a1011e2fbc373592c08faab. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"1024B","# Reas. Tokens":"6413.1","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### Tongyi-DeepResearch Pass@1: 67.7. Result ID: 6a1011e2fbc373592c08fab4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"7431.8","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### GLM-4.6 Pass@1: 60.9. Result ID: 6a1011e2fbc373592c08faa9. [Reporting paper]() Recorded evaluation configuration: {"Size":"357B","# Reas. Tokens":"3580.4","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### GPT-OSS-120B-high Pass@1: 54.9. Result ID: 6a1011e2fbc373592c08faa7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"120B","# Reas. Tokens":"2700.4","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### ASearcher-Web-QWQ-v2 Pass@1: 50.5. Result ID: 6a1011e2fbc373592c08fab3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"32B","# Reas. Tokens":"116752.9","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### Qwen3-235B Pass@1: 50. Result ID: 6a1011e2fbc373592c08faa8. [Reporting paper]() Recorded evaluation configuration: {"Size":"235B","# Reas. Tokens":"6467.4","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### WebSailor-32B Pass@1: 46.1. Result ID: 6a1011e2fbc373592c08fab2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"32B","# Reas. Tokens":"1055.2","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### SR2AM-v0.1-8B Pass@1: 46.1. Result ID: 6a1011e2fbc373592c08fab9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"8B","# Reas. Tokens":"3697.6","Reasoning Paradigm":"Self-Regulated Simulative Reasoning"}. This record does not assert independent reproduction. ### WebExplorer-8B Pass@1: 43.5. Result ID: 6a1011e2fbc373592c08fab0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"8B","# Reas. Tokens":"3616.9","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### GPT-5.4-xhigh Pass@1: 42. Result ID: 6a1011e2fbc373592c08faa5. [Reporting paper]() Recorded evaluation configuration: {"Size":"—","# Reas. Tokens":"8810.3","Reasoning Paradigm":"Reasoning LLMs"}. This record does not assert independent reproduction. ### A2FM Pass@1: 38.8. Result ID: 6a1011e2fbc373592c08fab8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"32B","# Reas. Tokens":"23424.8","Reasoning Paradigm":"Mode Routing"}. This record does not assert independent reproduction. ### DeepSeek-V3.2 Pass@1: 37.1. Result ID: 6a1011e2fbc373592c08faa4. [Reporting paper]() Recorded evaluation configuration: {"Size":"685B","# Reas. Tokens":"9306.2","Reasoning Paradigm":"Reasoning LLMs"}. This record does not assert independent reproduction. ### Qwen3-30B-A3B Pass@1: 36.9. Result ID: 6a1011e2fbc373592c08faa6. [Reporting paper]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"5410.1","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### WebSailor-7B Pass@1: 35.2. Result ID: 6a1011e2fbc373592c08faaf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"2211.5","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### K2-Think-V2-high Pass@1: 27.4. Result ID: 6a1011e2fbc373592c08faa3. [Reporting paper]() Recorded evaluation configuration: {"Size":"73B","# Reas. Tokens":"31905.2","Reasoning Paradigm":"Reasoning LLMs"}. This record does not assert independent reproduction. ### AFM-Web-7B-RL Pass@1: 22.6. Result ID: 6a1011e2fbc373592c08fab6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"2608.6","Reasoning Paradigm":"Workflow Distillation"}. This record does not assert independent reproduction. ### ASearcher-Web-7B Pass@1: 20.4. Result ID: 6a1011e2fbc373592c08faad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"601.4","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### Qwen3-30B-A3B Pass@1: 18.9. Result ID: 6a1011e2fbc373592c08faa2. [Reporting paper]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"8269.1","Reasoning Paradigm":"Reasoning LLMs"}. This record does not assert independent reproduction. ### SimpleTIR-32B Pass@1: 11.9. Result ID: 6a1011e2fbc373592c08fab1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"32B","# Reas. Tokens":"5174.8","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### SimpleTIR-7B Pass@1: 8.7. Result ID: 6a1011e2fbc373592c08faae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"3551.7","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### AFM-Code-7B-RL Pass@1: 7.8. Result ID: 6a1011e2fbc373592c08fab7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"11205.5","Reasoning Paradigm":"Workflow Distillation"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.