# Function-name selection on Seal-Tools single-call K=5 (294 tasks/model) Source: [Function-name selection on Seal-Tools single-call K=5 (294 tasks/model)]() Collection index: [llms.txt]() Data updated: 2026-06-16T09:58:01.782Z Evaluation of model performance on the Function-name selection task using the specific Seal-Tools single-call K=5 configuration (294 tasks/model), measured by Accuracy and Delta (∆). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Function-name selection | | Dataset (including any stated split) | Seal-Tools single-call K=5 (294 tasks/model) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 8 of 8 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Delta (∆)](): Higher is better; unit: SCALAR. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Llama-3.1-8B | 93.2 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-1.5B | 91.5 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Pooled | 90.7 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-7B | 87.4 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-1.5B | 79.6 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Llama-3.1-8B | 76.5 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Pooled | 75.9 | Not recorded | 6a30d90ad33dfb23e783d1fc | | Qwen2.5-7B | 71.4 | Not recorded | 6a30d90ad33dfb23e783d1fc | ### Llama-3.1-8B Accuracy: 93.2. Result ID: 6a311e14fbc373592c2df8f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B Accuracy: 91.5. Result ID: 6a311e14fbc373592c2df8ed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Pooled Accuracy: 90.7. Result ID: 6a311e14fbc373592c2df8f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Qwen2.5-7B Accuracy: 87.4. Result ID: 6a311e14fbc373592c2df8ef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Gold-free S2"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B Accuracy: 79.6. Result ID: 6a311e14fbc373592c2df8ec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### Llama-3.1-8B Accuracy: 76.5. Result ID: 6a311e14fbc373592c2df8f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### Pooled Accuracy: 75.9. Result ID: 6a311e14fbc373592c2df8f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. ### Qwen2.5-7B Accuracy: 71.4. Result ID: 6a311e14fbc373592c2df8ee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"setting":"Base"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.