News Headline Generation on LaMP News Headline (test)
15.1ROUGE-1TITOK
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TITOKData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 15.1 | 13.6 | |
| TITOKData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 15.1 | 13.7 | |
| TITOKData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 13.3 | 12 | |
| KDData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 12.7 | 11.3 | |
| MinEDData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 12.4 | 11 | |
| MinEDData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 11.8 | 10.6 | |
| VanillaData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 11.7 | 10.1 | |
| VanillaData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 11.7 | 10.1 | |
| VanillaData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 11.7 | 10.1 |