# Tool-use and Complex Reasoning on GAIA Level 2 Source: [Tool-use and Complex Reasoning on GAIA Level 2]() Collection index: [llms.txt]() Data updated: 2026-04-23T06:46:48.072Z Evaluation of model performance on tool-use and complex reasoning capabilities specifically on the Level 2 subset of the GAIA benchmark, measured using Pass@1. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Tool-use and Complex Reasoning | | Dataset (including any stated split) | GAIA Level 2 | | Metric | Pass@1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 15 of 15 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Pass@1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Pass@1 | Result date | Report paper | | --- | --- | --- | --- | | OMAC | 14.24 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 13.74 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 13.04 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 12.88 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 12.14 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 11.97 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 11.93 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 11.73 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 10.92 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 10.7 | Not recorded | 68fa78bd1e209131cea7a267 | | OMAC | 10.16 | Not recorded | 68fa78bd1e209131cea7a267 | | DyLAN | 9.82 | Not recorded | 68fa78bd1e209131cea7a267 | | Aflow | 8.23 | Not recorded | 68fa78bd1e209131cea7a267 | | ADAS | 3.87 | Not recorded | 68fa78bd1e209131cea7a267 | | AutoGPT | 1.04 | Not recorded | 68fa78bd1e209131cea7a267 | ### OMAC Pass@1: 14.24. Result ID: 69e9bff647f34ce924d05155. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Functional","Configuration":"Fun-2"}. This record does not assert independent reproduction. ### OMAC Pass@1: 13.74. Result ID: 69e9bff647f34ce924d05153. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Functional","Configuration":"Fun-1.6"}. This record does not assert independent reproduction. ### OMAC Pass@1: 13.04. Result ID: 69e9bff647f34ce924d05151. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Functional","Configuration":"Fun-1.4"}. This record does not assert independent reproduction. ### OMAC Pass@1: 12.88. Result ID: 69e9bff647f34ce924d0514d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Structural","Configuration":"Str-3"}. This record does not assert independent reproduction. ### OMAC Pass@1: 12.14. Result ID: 69e9bff647f34ce924d0514e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Functional","Configuration":"Fun-1.1"}. This record does not assert independent reproduction. ### OMAC Pass@1: 11.97. Result ID: 69e9bff647f34ce924d05152. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Functional","Configuration":"Fun-1.5"}. This record does not assert independent reproduction. ### OMAC Pass@1: 11.93. Result ID: 69e9bff647f34ce924d0514b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Structural","Configuration":"Str-1"}. This record does not assert independent reproduction. ### OMAC Pass@1: 11.73. Result ID: 69e9bff647f34ce924d05150. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Functional","Configuration":"Fun-1.3"}. This record does not assert independent reproduction. ### OMAC Pass@1: 10.92. Result ID: 69e9bff647f34ce924d0514f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Functional","Configuration":"Fun-1.2"}. This record does not assert independent reproduction. ### OMAC Pass@1: 10.7. Result ID: 69e9bff647f34ce924d05154. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Functional","Configuration":"Fun-1.7"}. This record does not assert independent reproduction. ### OMAC Pass@1: 10.16. Result ID: 69e9bff647f34ce924d0514c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Optimization Dimension":"Structural","Configuration":"Str-2"}. This record does not assert independent reproduction. ### DyLAN Pass@1: 9.82. Result ID: 69e9bff647f34ce924d0514a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Aflow Pass@1: 8.23. Result ID: 69e9bff647f34ce924d05149. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ADAS Pass@1: 3.87. Result ID: 69e9bff647f34ce924d05148. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### AutoGPT Pass@1: 1.04. Result ID: 69e9bff647f34ce924d05147. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.