Tool-use and Complex Reasoning on GAIA Level 2
14.24Pass@1OMAC
Evaluation Results
| Method | Links | |
|---|---|---|
| OMACOptimization Dimension=Functional, Configuration=Fun-22025.05 | 14.24 | |
| OMACOptimization Dimension=Functional, Configuration=Fun-1.62025.05 | 13.74 | |
| OMACOptimization Dimension=Functional, Configuration=Fun-1.42025.05 | 13.04 | |
| OMACOptimization Dimension=Structural, Configuration=Str-32025.05 | 12.88 | |
| OMACOptimization Dimension=Functional, Configuration=Fun-1.12025.05 | 12.14 | |
| OMACOptimization Dimension=Functional, Configuration=Fun-1.52025.05 | 11.97 | |
| OMACOptimization Dimension=Structural, Configuration=Str-12025.05 | 11.93 | |
| OMACOptimization Dimension=Functional, Configuration=Fun-1.32025.05 | 11.73 | |
| OMACOptimization Dimension=Functional, Configuration=Fun-1.22025.05 | 10.92 | |
| OMACOptimization Dimension=Functional, Configuration=Fun-1.72025.05 | 10.7 | |
| OMACOptimization Dimension=Structural, Configuration=Str-22025.05 | 10.16 | |
| DyLAN2025.05 | 9.82 | |
| Aflow2025.05 | 8.23 | |
| ADAS2025.05 | 3.87 | |
| AutoGPT2025.05 | 1.04 |