# Function-name selection on BFCL multiple live (300 tasks model) Source: [Function-name selection on BFCL multiple live (300 tasks model)]() Collection index: [llms.txt]() Data updated: 2026-06-16T09:58:01.751Z Evaluation of Function-name selection performance using the BFCL multiple live dataset, specifically configured for the 300 tasks model, reporting Accuracy and Delta (∆). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Function-name selection | | Dataset (including any stated split) | BFCL multiple live (300 tasks model) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Delta (∆)](): Higher is better; unit: SCALAR. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Qwen2.5-1.5B | 97.7 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Llama-3.1-8B | 96 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Pooled (3) | 95.9 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-7B | 94 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Llama-3.1-8B | 91.7 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen3-8B | 91.3 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-7B | 90 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Pooled (3) | 89.9 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Pooled (5) | 89.1 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-1.5B | 88 | Not recorded | 6a30d90ad33dfb23e783d1fc | | xLAM-2-8B | 84.7 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen3-8B | 83.7 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-1.5B | 81.3 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Llama-3.1-8B | 80.3 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Pooled (3) | 78 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Pooled (5) | 77.9 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-7B | 72.3 | Not recorded | 6a30d90ad33dfb23e783d1fc | | xLAM-2-8B | 72 | Not recorded | 6a30d90ad33dfb23e783d1fc | ### Qwen2.5-1.5B Accuracy: 97.7. Result ID: 6a311e14fbc373592c2df8db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Oracle δ+8"}. This record does not assert independent reproduction. ### Llama-3.1-8B Accuracy: 96. Result ID: 6a311e14fbc373592c2df8e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Oracle δ+8"}. This record does not assert independent reproduction. ### Pooled (3) Accuracy: 95.9. Result ID: 6a311e14fbc373592c2df8e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Oracle δ+8"}. This record does not assert independent reproduction. ### Qwen2.5-7B Accuracy: 94. Result ID: 6a311e14fbc373592c2df8de. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Oracle δ+8"}. This record does not assert independent reproduction. ### Llama-3.1-8B Accuracy: 91.7. Result ID: 6a311e14fbc373592c2df8e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Qwen3-8B Accuracy: 91.3. Result ID: 6a311e14fbc373592c2df8e7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Qwen2.5-7B Accuracy: 90. Result ID: 6a311e14fbc373592c2df8df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Pooled (3) Accuracy: 89.9. Result ID: 6a311e14fbc373592c2df8e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Pooled (5) Accuracy: 89.1. Result ID: 6a311e14fbc373592c2df8eb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B Accuracy: 88. Result ID: 6a311e14fbc373592c2df8dc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### xLAM-2-8B Accuracy: 84.7. Result ID: 6a311e14fbc373592c2df8e9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Qwen3-8B Accuracy: 83.7. Result ID: 6a311e14fbc373592c2df8e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B Accuracy: 81.3. Result ID: 6a311e14fbc373592c2df8da. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### Llama-3.1-8B Accuracy: 80.3. Result ID: 6a311e14fbc373592c2df8e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### Pooled (3) Accuracy: 78. Result ID: 6a311e14fbc373592c2df8e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### Pooled (5) Accuracy: 77.9. Result ID: 6a311e14fbc373592c2df8ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### Qwen2.5-7B Accuracy: 72.3. Result ID: 6a311e14fbc373592c2df8dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### xLAM-2-8B Accuracy: 72. Result ID: 6a311e14fbc373592c2df8e8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.