# Tool-use agentic performance on AppWorld Source: [Tool-use agentic performance on AppWorld]() Collection index: [llms.txt]() Data updated: 2026-04-07T10:55:53.138Z Evaluation of agent performance using Tool-use agentic tasks on the AppWorld environment, measured by Avg@4 and Pass@4. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Tool-use agentic performance | | Dataset (including any stated split) | AppWorld | | Metric | Avg@4 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 19 of 19 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Avg@4](): Higher is better; unit: PERCENT. - [Pass@4](): Higher is better; unit: PERCENT. ## Recorded results | Method | Avg@4 | Result date | Report paper | | --- | --- | --- | --- | | SkillX | 64.88 | Not recorded | 69d48fc27d0172140ec745ee | | ExpeL | 64.14 | Not recorded | 69d48fc27d0172140ec745ee | | AWM | 62.2 | Not recorded | 69d48fc27d0172140ec745ee | | A-Mem | 60.57 | Not recorded | 69d48fc27d0172140ec745ee | | No Memory | 60.27 | Not recorded | 69d48fc27d0172140ec745ee | | SkillX | 56.4 | Not recorded | 69d48fc27d0172140ec745ee | | ExpeL | 52.98 | Not recorded | 69d48fc27d0172140ec745ee | | ExpeL | 52.53 | Not recorded | 69d48fc27d0172140ec745ee | | AWM | 50.6 | Not recorded | 69d48fc27d0172140ec745ee | | AWM | 49.7 | Not recorded | 69d48fc27d0172140ec745ee | | No Memory | 46.88 | Not recorded | 69d48fc27d0172140ec745ee | | A-Mem | 46.58 | Not recorded | 69d48fc27d0172140ec745ee | | SkillX | 35.12 | Not recorded | 69d48fc27d0172140ec745ee | | AWM | 34.45 | Not recorded | 69d48fc27d0172140ec745ee | | ExpeL | 32.94 | Not recorded | 69d48fc27d0172140ec745ee | | ExpeL | 32.87 | Not recorded | 69d48fc27d0172140ec745ee | | AWM | 30.8 | Not recorded | 69d48fc27d0172140ec745ee | | No Memory | 27.68 | Not recorded | 69d48fc27d0172140ec745ee | | A-Mem | 26.79 | Not recorded | 69d48fc27d0172140ec745ee | ### SkillX Avg@4: 64.88. Result ID: 69d4e2b247f34ce924bd82e4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GLM-4.6","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### ExpeL Avg@4: 64.14. Result ID: 69d4e2b247f34ce924bd82e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GLM-4.6","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### AWM Avg@4: 62.2. Result ID: 69d4e2b247f34ce924bd82e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GLM-4.6","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### A-Mem Avg@4: 60.57. Result ID: 69d4e2b247f34ce924bd82e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GLM-4.6","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### No Memory Avg@4: 60.27. Result ID: 69d4e2b247f34ce924bd82e0. [Reporting paper]() Recorded evaluation configuration: {"Model":"GLM-4.6","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### SkillX Avg@4: 56.4. Result ID: 69d4e2b247f34ce924bd82df. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Kimi-K2-Instruct-0905","Experience extraction model alignment":"GLM-4.6 used for experience extraction"}. This record does not assert independent reproduction. ### ExpeL Avg@4: 52.98. Result ID: 69d4e2b247f34ce924bd82de. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Kimi-K2-Instruct-0905","Experience extraction model alignment":"GLM-4.6 used for experience extraction"}. This record does not assert independent reproduction. ### ExpeL Avg@4: 52.53. Result ID: 69d4e2b247f34ce924bd82dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Kimi-K2-Instruct-0905","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### AWM Avg@4: 50.6. Result ID: 69d4e2b247f34ce924bd82dc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Kimi-K2-Instruct-0905","Experience extraction model alignment":"GLM-4.6 used for experience extraction"}. This record does not assert independent reproduction. ### AWM Avg@4: 49.7. Result ID: 69d4e2b247f34ce924bd82db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Kimi-K2-Instruct-0905","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### No Memory Avg@4: 46.88. Result ID: 69d4e2b247f34ce924bd82d9. [Reporting paper]() Recorded evaluation configuration: {"Model":"Kimi-K2-Instruct-0905","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### A-Mem Avg@4: 46.58. Result ID: 69d4e2b247f34ce924bd82da. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Kimi-K2-Instruct-0905","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### SkillX Avg@4: 35.12. Result ID: 69d4e2b247f34ce924bd82d8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen3-32B","Experience extraction model alignment":"GLM-4.6 used for experience extraction"}. This record does not assert independent reproduction. ### AWM Avg@4: 34.45. Result ID: 69d4e2b247f34ce924bd82d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-32B","Experience extraction model alignment":"GLM-4.6 used for experience extraction"}. This record does not assert independent reproduction. ### ExpeL Avg@4: 32.94. Result ID: 69d4e2b247f34ce924bd82d7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-32B","Experience extraction model alignment":"GLM-4.6 used for experience extraction"}. This record does not assert independent reproduction. ### ExpeL Avg@4: 32.87. Result ID: 69d4e2b247f34ce924bd82d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-32B","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### AWM Avg@4: 30.8. Result ID: 69d4e2b247f34ce924bd82d4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-32B","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### No Memory Avg@4: 27.68. Result ID: 69d4e2b247f34ce924bd82d2. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen3-32B","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. ### A-Mem Avg@4: 26.79. Result ID: 69d4e2b247f34ce924bd82d3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-32B","Experience extraction model alignment":"Aligned with inference model"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.