Scholarly Title Generation on Scholarly Title
47.3ROUGE-1TiToK
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TiToKTransfer=Mistral 7B → Mistral 7B, Evaluation Mode=Zero-shot2025.10 | 47.3 | 41.3 | |
| TITOKTransfer setting=Mistral 7B → Mistral 7B, k=70%, Evaluation Protocol=Zero-shot2025.10 | 47.3 | 41.3 | |
| TiToKTransfer=Mistral 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 46.4 | 40.3 | |
| TITOKTransfer setting=Mistral 7B → Llama3 8B, k=70%, Evaluation Protocol=Zero-shot2025.10 | 46.4 | 40.3 | |
| TransLoRATransfer=Mistral 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 46.1 | 39.7 | |
| TiToKTransfer=Llama2 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 46.1 | 40.3 | |
| TransLoRATransfer setting=Mistral 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 46.1 | 39.7 | |
| TITOKTransfer setting=Llama2 7B → Llama3 8B, k=70%, Evaluation Protocol=Zero-shot2025.10 | 46.1 | 40.3 | |
| TransLoRATransfer=Llama2 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 45.7 | 39.4 | |
| TransLoRATransfer setting=Llama2 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 45.7 | 39.4 | |
| TiToKTransfer=Llama3 3B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 45.6 | 39.2 | |
| TITOKTransfer setting=Llama3 3B → Llama3 8B, k=30%, Evaluation Protocol=Zero-shot2025.10 | 45.6 | 39.2 | |
| KD (+MinED)Transfer=Mistral 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 45.4 | 38.7 | |
| TransLoRATransfer=Llama3 3B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 45.4 | 38.7 | |
| KDTransfer setting=Mistral 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 45.4 | 38.7 | |
| TransLoRATransfer setting=Llama3 3B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 45.4 | 38.7 | |
| KD (+MinED)Transfer=Llama3 3B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 44.9 | 38.3 | |
| KD (+MinED)Transfer=Llama2 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 44.9 | 38.2 | |
| KDTransfer setting=Llama3 3B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 44.9 | 38.3 | |
| KDTransfer setting=Llama2 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 44.9 | 38.2 | |
| TransLoRATransfer=Mistral 7B → Mistral 7B, Evaluation Mode=Zero-shot2025.10 | 44.7 | 38.2 | |
| TransLoRATransfer setting=Mistral 7B → Mistral 7B, Evaluation Protocol=Zero-shot2025.10 | 44.7 | 38.2 | |
| VanillaTransfer=Mistral 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 44.4 | 37.8 | |
| VanillaTransfer=Llama3 3B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 44.4 | 37.8 | |
| VanillaTransfer=Llama2 7B → Llama3 8B, Evaluation Mode=Zero-shot2025.10 | 44.4 | 37.8 | |
| VanillaTransfer setting=Mistral 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 44.4 | 37.8 | |
| VanillaTransfer setting=Llama3 3B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 44.4 | 37.8 | |
| VanillaTransfer setting=Llama2 7B → Llama3 8B, Evaluation Protocol=Zero-shot2025.10 | 44.4 | 37.8 | |
| KD (+MinED)Transfer=Mistral 7B → Mistral 7B, Evaluation Mode=Zero-shot2025.10 | 38.5 | 31 | |
| KDTransfer setting=Mistral 7B → Mistral 7B, Evaluation Protocol=Zero-shot2025.10 | 38.5 | 31 | |
| VanillaTransfer=Mistral 7B → Mistral 7B, Evaluation Mode=Zero-shot2025.10 | 38.1 | 31.1 | |
| VanillaTransfer setting=Mistral 7B → Mistral 7B, Evaluation Protocol=Zero-shot2025.10 | 38.1 | 31.1 |