# Tool Learning under Instruction with Multiple Requests on NoisyToolBench IMR 1.0 (test) Source: [Tool Learning under Instruction with Multiple Requests on NoisyToolBench IMR 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-04-30T06:42:20.932Z Evaluation of model performance on Tool Learning under Instruction with Multiple Requests using the test split of NoisyToolBench IMR version 1.0, measured by A1, A2, and A3 metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Tool Learning under Instruction with Multiple Requests | | Dataset (including any stated split) | NoisyToolBench IMR 1.0 (test) | | Metric | A1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [A1 Score](): Higher is better; unit: PERCENT. - [A2 Score](): Higher is better; unit: PERCENT. - [A3 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | A1 Score | Result date | Report paper | | --- | --- | --- | --- | | DFSDT + AwN | 90 | Not recorded | 68fa77061e209131cea7092e | | DFSDT + AwN | 88 | Not recorded | 68fa77061e209131cea7092e | | CoT + AwN | 86 | Not recorded | 68fa77061e209131cea7092e | | DFSDT + AwN | 82 | Not recorded | 68fa77061e209131cea7092e | | DFSDT + AwN | 80 | Not recorded | 68fa77061e209131cea7092e | | CoT + AwN | 80 | Not recorded | 68fa77061e209131cea7092e | | CoT + AwN | 76 | Not recorded | 68fa77061e209131cea7092e | | DFSDT + AwN | 76 | Not recorded | 68fa77061e209131cea7092e | | CoT + AwN | 76 | Not recorded | 68fa77061e209131cea7092e | | DFSDT + AwN | 76 | Not recorded | 68fa77061e209131cea7092e | | CoT + AwN | 74 | Not recorded | 68fa77061e209131cea7092e | | CoT | 72 | Not recorded | 68fa77061e209131cea7092e | | DFSDT | 70 | Not recorded | 68fa77061e209131cea7092e | | CoT + AwN | 70 | Not recorded | 68fa77061e209131cea7092e | | DFSDT + AwN | 62 | Not recorded | 68fa77061e209131cea7092e | | DFSDT | 60 | Not recorded | 68fa77061e209131cea7092e | | DFSDT | 60 | Not recorded | 68fa77061e209131cea7092e | | DFSDT | 60 | Not recorded | 68fa77061e209131cea7092e | | CoT + AwN | 60 | Not recorded | 68fa77061e209131cea7092e | | CoT + AwN | 32 | Not recorded | 68fa77061e209131cea7092e | | DFSDT + AwN | 32 | Not recorded | 68fa77061e209131cea7092e | | DFSDT | 26 | Not recorded | 68fa77061e209131cea7092e | | CoT | 24 | Not recorded | 68fa77061e209131cea7092e | | CoT | 22 | Not recorded | 68fa77061e209131cea7092e | | CoT | 20 | Not recorded | 68fa77061e209131cea7092e | | CoT | 18 | Not recorded | 68fa77061e209131cea7092e | | CoT | 12 | Not recorded | 68fa77061e209131cea7092e | | DFSDT | 12 | Not recorded | 68fa77061e209131cea7092e | | DFSDT | 4 | Not recorded | 68fa77061e209131cea7092e | | CoT | 2 | Not recorded | 68fa77061e209131cea7092e | | CoT | 0 | Not recorded | 68fa77061e209131cea7092e | | DFSDT | 0 | Not recorded | 68fa77061e209131cea7092e | ### DFSDT + AwN A1 Score: 90. Result ID: 69f2f91c47f34ce924d8bd09. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-4o"}. This record does not assert independent reproduction. ### DFSDT + AwN A1 Score: 88. Result ID: 69f2f91c47f34ce924d8bd01. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-3.5"}. This record does not assert independent reproduction. ### CoT + AwN A1 Score: 86. Result ID: 69f2f91c47f34ce924d8bcff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-3.5"}. This record does not assert independent reproduction. ### DFSDT + AwN A1 Score: 82. Result ID: 69f2f91c47f34ce924d8bd0d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"deepseek-v3"}. This record does not assert independent reproduction. ### DFSDT + AwN A1 Score: 80. Result ID: 69f2f91c47f34ce924d8bd05. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-4"}. This record does not assert independent reproduction. ### CoT + AwN A1 Score: 80. Result ID: 69f2f91c47f34ce924d8bd07. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-4o"}. This record does not assert independent reproduction. ### CoT + AwN A1 Score: 76. Result ID: 69f2f91c47f34ce924d8bd03. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-4"}. This record does not assert independent reproduction. ### DFSDT + AwN A1 Score: 76. Result ID: 69f2f91c47f34ce924d8bd11. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gemini-1.5"}. This record does not assert independent reproduction. ### CoT + AwN A1 Score: 76. Result ID: 69f2f91c47f34ce924d8bd17. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"O3-mini"}. This record does not assert independent reproduction. ### DFSDT + AwN A1 Score: 76. Result ID: 69f2f91c47f34ce924d8bd19. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"O3-mini"}. This record does not assert independent reproduction. ### CoT + AwN A1 Score: 74. Result ID: 69f2f91c47f34ce924d8bd0f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gemini-1.5"}. This record does not assert independent reproduction. ### CoT A1 Score: 72. Result ID: 69f2f91c47f34ce924d8bd02. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-4"}. This record does not assert independent reproduction. ### DFSDT A1 Score: 70. Result ID: 69f2f91c47f34ce924d8bd04. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"gpt-4"}. This record does not assert independent reproduction. ### CoT + AwN A1 Score: 70. Result ID: 69f2f91c47f34ce924d8bd0b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"deepseek-v3"}. This record does not assert independent reproduction. ### DFSDT + AwN A1 Score: 62. Result ID: 69f2f91c47f34ce924d8bd1d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"DeepSeek-R1"}. This record does not assert independent reproduction. ### DFSDT A1 Score: 60. Result ID: 69f2f91c47f34ce924d8bd00. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"gpt-3.5"}. This record does not assert independent reproduction. ### DFSDT A1 Score: 60. Result ID: 69f2f91c47f34ce924d8bd0c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"deepseek-v3"}. This record does not assert independent reproduction. ### DFSDT A1 Score: 60. Result ID: 69f2f91c47f34ce924d8bd10. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"gemini-1.5"}. This record does not assert independent reproduction. ### CoT + AwN A1 Score: 60. Result ID: 69f2f91c47f34ce924d8bd1b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"DeepSeek-R1"}. This record does not assert independent reproduction. ### CoT + AwN A1 Score: 32. Result ID: 69f2f91c47f34ce924d8bd13. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"claude-3.5"}. This record does not assert independent reproduction. ### DFSDT + AwN A1 Score: 32. Result ID: 69f2f91c47f34ce924d8bd15. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"claude-3.5"}. This record does not assert independent reproduction. ### DFSDT A1 Score: 26. Result ID: 69f2f91c47f34ce924d8bd08. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"gpt-4o"}. This record does not assert independent reproduction. ### CoT A1 Score: 24. Result ID: 69f2f91c47f34ce924d8bd0a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"deepseek-v3"}. This record does not assert independent reproduction. ### CoT A1 Score: 22. Result ID: 69f2f91c47f34ce924d8bd0e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gemini-1.5"}. This record does not assert independent reproduction. ### CoT A1 Score: 20. Result ID: 69f2f91c47f34ce924d8bcfe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-3.5"}. This record does not assert independent reproduction. ### CoT A1 Score: 18. Result ID: 69f2f91c47f34ce924d8bd06. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"gpt-4o"}. This record does not assert independent reproduction. ### CoT A1 Score: 12. Result ID: 69f2f91c47f34ce924d8bd12. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"claude-3.5"}. This record does not assert independent reproduction. ### DFSDT A1 Score: 12. Result ID: 69f2f91c47f34ce924d8bd14. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"claude-3.5"}. This record does not assert independent reproduction. ### DFSDT A1 Score: 4. Result ID: 69f2f91c47f34ce924d8bd1c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"DeepSeek-R1"}. This record does not assert independent reproduction. ### CoT A1 Score: 2. Result ID: 69f2f91c47f34ce924d8bd1a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"DeepSeek-R1"}. This record does not assert independent reproduction. ### CoT A1 Score: 0. Result ID: 69f2f91c47f34ce924d8bd16. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"O3-mini"}. This record does not assert independent reproduction. ### DFSDT A1 Score: 0. Result ID: 69f2f91c47f34ce924d8bd18. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"O3-mini"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.