# Language Generation on Dolly databricks 15k (test) Source: [Language Generation on Dolly databricks 15k (test)]() Collection index: [llms.txt]() Data updated: 2026-03-05T08:49:25.603Z Evaluation of language generation capabilities using the test split of the Databricks Dolly 15k dataset, typically measured using ROUGE metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Language Generation | | Dataset (including any stated split) | Dolly databricks 15k (test) | | Metric | ROUGE-L | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ROUGE-L](): Higher is better; unit: PERCENT. ## Recorded results | Method | ROUGE-L | Result date | Report paper | | --- | --- | --- | --- | | Teacher | 29.7 | Not recorded | 69a90e112d603e6de3e4083f | | VQAE | 28.2 | Not recorded | 69a90e112d603e6de3e4083f | | Teacher | 27.6 | Not recorded | 69a90e112d603e6de3e4083f | | SeqKD | 27.5 | Not recorded | 69a90e112d603e6de3e4083f | | KD | 27.4 | Not recorded | 69a90e112d603e6de3e4083f | | SFT w/o KD | 26.3 | Not recorded | 69a90e112d603e6de3e4083f | | KD | 25.9 | Not recorded | 69a90e112d603e6de3e4083f | | VQAE | 25.7 | Not recorded | 69a90e112d603e6de3e4083f | | SeqKD | 25.6 | Not recorded | 69a90e112d603e6de3e4083f | | SFT w/o KD | 25.4 | Not recorded | 69a90e112d603e6de3e4083f | | VQAE | 23.5 | Not recorded | 69a90e112d603e6de3e4083f | | SFT w/o KD | 23.3 | Not recorded | 69a90e112d603e6de3e4083f | | KD | 22.8 | Not recorded | 69a90e112d603e6de3e4083f | | SeqKD | 22.7 | Not recorded | 69a90e112d603e6de3e4083f | ### Teacher ROUGE-L: 29.7. Result ID: 69a943826dbb7075b952d109. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA","#Params":"13B"}. This record does not assert independent reproduction. ### VQAE ROUGE-L: 28.2. Result ID: 69a943826dbb7075b952d10d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA","#Params":"7B"}. This record does not assert independent reproduction. ### Teacher ROUGE-L: 27.6. Result ID: 69a943826dbb7075b952d100. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"1.5B"}. This record does not assert independent reproduction. ### SeqKD ROUGE-L: 27.5. Result ID: 69a943826dbb7075b952d10c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA","#Params":"7B"}. This record does not assert independent reproduction. ### KD ROUGE-L: 27.4. Result ID: 69a943826dbb7075b952d10b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA","#Params":"7B"}. This record does not assert independent reproduction. ### SFT w/o KD ROUGE-L: 26.3. Result ID: 69a943826dbb7075b952d10a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA","#Params":"7B"}. This record does not assert independent reproduction. ### KD ROUGE-L: 25.9. Result ID: 69a943826dbb7075b952d106. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"760M"}. This record does not assert independent reproduction. ### VQAE ROUGE-L: 25.7. Result ID: 69a943826dbb7075b952d108. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"760M"}. This record does not assert independent reproduction. ### SeqKD ROUGE-L: 25.6. Result ID: 69a943826dbb7075b952d107. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"760M"}. This record does not assert independent reproduction. ### SFT w/o KD ROUGE-L: 25.4. Result ID: 69a943826dbb7075b952d105. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"760M"}. This record does not assert independent reproduction. ### VQAE ROUGE-L: 23.5. Result ID: 69a943826dbb7075b952d104. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"120M"}. This record does not assert independent reproduction. ### SFT w/o KD ROUGE-L: 23.3. Result ID: 69a943826dbb7075b952d101. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"120M"}. This record does not assert independent reproduction. ### KD ROUGE-L: 22.8. Result ID: 69a943826dbb7075b952d102. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"120M"}. This record does not assert independent reproduction. ### SeqKD ROUGE-L: 22.7. Result ID: 69a943826dbb7075b952d103. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-2","#Params":"120M"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.