# Tool Response Generation on GTM Single-turn Source: [Tool Response Generation on GTM Single-turn]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:45:30.530Z Evaluation of model performance on generating single-turn responses using the GTM dataset, assessed via metrics covering Format, Logic, Semantics, Completeness, and Overall quality. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Tool Response Generation | | Dataset (including any stated split) | GTM Single-turn | | Metric | Format Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Format Score](): Higher is better; unit: PERCENT. - [Logic Score](): Higher is better; unit: PERCENT. - [Semantics Score](): Higher is better; unit: PERCENT. - [Completeness Score](): Higher is better; unit: PERCENT. - [Overall Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Format Score | Result date | Report paper | | --- | --- | --- | --- | | Qwen2.5-7B-Instruct | 99.6 | Not recorded | 69326755d6b0dd3342934552 | | Qwen2.5-14B-Instruct | 99.3 | Not recorded | 69326755d6b0dd3342934552 | | GTM-1.5B | 99.2 | Not recorded | 69326755d6b0dd3342934552 | | Qwen2.5-0.5B-Instruct | 97.4 | Not recorded | 69326755d6b0dd3342934552 | | Qwen2.5-1.5B-Instruct | 97 | Not recorded | 69326755d6b0dd3342934552 | | Llama-3.2-3B-Instruct | 96.3 | Not recorded | 69326755d6b0dd3342934552 | | Qwen2.5-3B-Instruct | 95.3 | Not recorded | 69326755d6b0dd3342934552 | | InternLM2.5-20B | 86.4 | Not recorded | 69326755d6b0dd3342934552 | | InternLM2.5-7B | 72.2 | Not recorded | 69326755d6b0dd3342934552 | | Llama-3.2-1B-Instruct | 69.6 | Not recorded | 69326755d6b0dd3342934552 | | InternLM2.5-1.8B | 56 | Not recorded | 69326755d6b0dd3342934552 | ### Qwen2.5-7B-Instruct Format Score: 99.6. Result ID: 69962f425698665ec470f8c2. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"7B"}. This record does not assert independent reproduction. ### Qwen2.5-14B-Instruct Format Score: 99.3. Result ID: 69962f425698665ec470f8c3. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"14B"}. This record does not assert independent reproduction. ### GTM-1.5B Format Score: 99.2. Result ID: 69962f425698665ec470f8c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Size":"1.5B"}. This record does not assert independent reproduction. ### Qwen2.5-0.5B-Instruct Format Score: 97.4. Result ID: 69962f425698665ec470f8bf. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"0.5B"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct Format Score: 97. Result ID: 69962f425698665ec470f8c0. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"1.5B"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct Format Score: 96.3. Result ID: 69962f425698665ec470f8c5. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"3B"}. This record does not assert independent reproduction. ### Qwen2.5-3B-Instruct Format Score: 95.3. Result ID: 69962f425698665ec470f8c1. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"3B"}. This record does not assert independent reproduction. ### InternLM2.5-20B Format Score: 86.4. Result ID: 69962f425698665ec470f8c8. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"20B"}. This record does not assert independent reproduction. ### InternLM2.5-7B Format Score: 72.2. Result ID: 69962f425698665ec470f8c7. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"7B"}. This record does not assert independent reproduction. ### Llama-3.2-1B-Instruct Format Score: 69.6. Result ID: 69962f425698665ec470f8c4. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"1B"}. This record does not assert independent reproduction. ### InternLM2.5-1.8B Format Score: 56. Result ID: 69962f425698665ec470f8c6. [Reporting paper]() Recorded evaluation configuration: {"Model Size":"1.8B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.