List your company
ResearchFormerly WizWand

Scholarly Title Generation on Scholarly Title

47.3ROUGE-1TiToK
37.73240.21642.745.184Oct 6, 2025
Updated 8mo ago

Evaluation results

MethodLinks
TiToKTransfer=Mistral 7B → Mistral 7B, Evaluation Mode=Zero-shot2025.1047.341.3
TITOKTransfer setting=Mistral 7B → Mistral 7B, k=70%, Evaluation Protocol=Zero-shot2025.1047.341.3
TiToKTransfer=Mistral 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.1046.440.3
TITOKTransfer setting=Mistral 7B → Llama3 8B, k=70%, Evaluation Protocol=Zero-shot2025.1046.440.3
TransLoRATransfer=Mistral 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.1046.139.7
TiToKTransfer=Llama2 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.1046.140.3
TransLoRATransfer setting=Mistral 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1046.139.7
TITOKTransfer setting=Llama2 7B → Llama3 8B, k=70%, Evaluation Protocol=Zero-shot2025.1046.140.3
TransLoRATransfer=Llama2 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.1045.739.4
TransLoRATransfer setting=Llama2 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1045.739.4
TiToKTransfer=Llama3 3B → Llama3 8B, Evaluation Mode=Zero-shot2025.1045.639.2
TITOKTransfer setting=Llama3 3B → Llama3 8B, k=30%, Evaluation Protocol=Zero-shot2025.1045.639.2
KD (+MinED)Transfer=Mistral 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.1045.438.7
TransLoRATransfer=Llama3 3B → Llama3 8B, Evaluation Mode=Zero-shot2025.1045.438.7
KDTransfer setting=Mistral 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1045.438.7
TransLoRATransfer setting=Llama3 3B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1045.438.7
KD (+MinED)Transfer=Llama3 3B → Llama3 8B, Evaluation Mode=Zero-shot2025.1044.938.3
KD (+MinED)Transfer=Llama2 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.1044.938.2
KDTransfer setting=Llama3 3B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1044.938.3
KDTransfer setting=Llama2 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1044.938.2
TransLoRATransfer=Mistral 7B → Mistral 7B, Evaluation Mode=Zero-shot2025.1044.738.2
TransLoRATransfer setting=Mistral 7B → Mistral 7B, Evaluation Protocol=Zero-shot2025.1044.738.2
VanillaTransfer=Mistral 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.1044.437.8
VanillaTransfer=Llama3 3B → Llama3 8B, Evaluation Mode=Zero-shot2025.1044.437.8
VanillaTransfer=Llama2 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.1044.437.8
VanillaTransfer setting=Mistral 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1044.437.8
VanillaTransfer setting=Llama3 3B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1044.437.8
VanillaTransfer setting=Llama2 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.1044.437.8
KD (+MinED)Transfer=Mistral 7B → Mistral 7B, Evaluation Mode=Zero-shot2025.1038.531
KDTransfer setting=Mistral 7B → Mistral 7B, Evaluation Protocol=Zero-shot2025.1038.531
VanillaTransfer=Mistral 7B → Mistral 7B, Evaluation Mode=Zero-shot2025.1038.131.1
VanillaTransfer setting=Mistral 7B → Mistral 7B, Evaluation Protocol=Zero-shot2025.1038.131.1