List your company
ResearchFormerly WizWand

Scholarly Title Generation on LaMP-5 1.0 (test)

0.483ROUGE-1In-Prompt Augmentation
0.376920.404460.4320.45954Apr 22, 2023Sep 18, 2023Feb 15, 2024Jul 14, 2024Dec 10, 2024May 9, 2025Oct 6, 2025
Updated 8mo ago

Evaluation results

MethodLinks
In-Prompt AugmentationBackbone=FlanT5-XXL, Evaluation Protocol=Zero-shot2023.040.4830.433
TITOKData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.4810.425
TITOKData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.480.422
FlanT5-XXLPersonalization=None, Evaluation Protocol=Zero-shot2023.040.4710.422
In-Prompt AugmentationBackbone=FlanT5-XXL, Evaluation Protocol=Zero-shot2023.040.450.411
TITOKData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.450.383
FlanT5-XXLPersonalization=None, Evaluation Protocol=Zero-shot2023.040.4420.4
In-Prompt AugmentationBackbone=GPT-3.5, Evaluation Protocol=Zero-shot2023.040.4250.351
GPT-3.5Personalization=None, Evaluation Protocol=Zero-shot2023.040.4240.355
MinEDData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.4090.337
KDData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.4050.333
MinEDData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.4030.331
In-Prompt AugmentationBackbone=GPT-3.5, Evaluation Protocol=Zero-shot2023.040.390.329
GPT-3.5Personalization=None, Evaluation Protocol=Zero-shot2023.040.3870.329
VanillaData Setting=Other-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.3810.311
VanillaData Setting=Mixed-user, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.3810.311
VanillaData Setting=Cross-task, Source Model=Mistral 7B, Target Model=Mistral 7B2025.100.3810.311