Scholarly Title Generation on LaMP-5 1.0 (test)
0.483ROUGE-1In-Prompt Augmentation
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| In-Prompt AugmentationBackbone=FlanT5-XXL, Evaluation Protocol=Zero-shot2023.04 | 0.483 | 0.433 | |
| TITOKData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.481 | 0.425 | |
| TITOKData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.48 | 0.422 | |
| FlanT5-XXLPersonalization=None, Evaluation Protocol=Zero-shot2023.04 | 0.471 | 0.422 | |
| In-Prompt AugmentationBackbone=FlanT5-XXL, Evaluation Protocol=Zero-shot2023.04 | 0.45 | 0.411 | |
| TITOKData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.45 | 0.383 | |
| FlanT5-XXLPersonalization=None, Evaluation Protocol=Zero-shot2023.04 | 0.442 | 0.4 | |
| In-Prompt AugmentationBackbone=GPT-3.5, Evaluation Protocol=Zero-shot2023.04 | 0.425 | 0.351 | |
| GPT-3.5Personalization=None, Evaluation Protocol=Zero-shot2023.04 | 0.424 | 0.355 | |
| MinEDData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.409 | 0.337 | |
| KDData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.405 | 0.333 | |
| MinEDData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.403 | 0.331 | |
| In-Prompt AugmentationBackbone=GPT-3.5, Evaluation Protocol=Zero-shot2023.04 | 0.39 | 0.329 | |
| GPT-3.5Personalization=None, Evaluation Protocol=Zero-shot2023.04 | 0.387 | 0.329 | |
| VanillaData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.381 | 0.311 | |
| VanillaData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.381 | 0.311 | |
| VanillaData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.10 | 0.381 | 0.311 |