Timeline Summarisation on TalkLife (test)
0.438FCP-PhiNST&PRT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| P-PhiNST&PRTTeacher Model=Phi, Data for Fine-Tuning Teacher Model=Narrative Reason, Transfer Method=NST&PRT, Student Model=Phi, Data for Fine-Tuning Student Model=Timeline Summarisation2024.12 | 0.438 | 0.973 | |
| L-PhiNST&PRTTeacher Model=LLaMA, Data for Fine-Tuning Teacher Model=Narrative Reason, Transfer Method=NST&PRT, Student Model=Phi, Data for Fine-Tuning Student Model=Timeline Summarisation2024.12 | 0.424 | 0.971 | |
| PhiICLStudent Model=Phi, Data for Fine-Tuning Student Model=Timeline Summarisation2024.12 | 0.412 | 0.965 | |
| TH-VAE2024.12 | 0.378 | 0.97 | |
| LLaMA2024.12 | 0.372 | 0.956 | |
| KDoriginTeacher Model=LLaMA, Transfer Method=NST&PRT, Student Model=Phi, Data for Fine-Tuning Student Model=Timeline Summarisation2024.12 | 0.332 | 0.967 | |
| KDtimlineTeacher Model=LLaMA, Data for Fine-Tuning Teacher Model=Timeline Summarisation, Transfer Method=NST&PRT, Student Model=Phi, Data for Fine-Tuning Student Model=Timeline Summarisation2024.12 | 0.33 | 0.965 | |
| PhijointStudent Model=Phi, Data for Fine-Tuning Student Model=Timeline Summarisation & Narrative Reason2024.12 | 0.238 | 0.941 | |
| PhitlStudent Model=Phi, Data for Fine-Tuning Student Model=Timeline Summarisation2024.12 | 0.184 | 0.966 | |
| PhitempStudent Model=Phi, Data for Fine-Tuning Student Model=Narrative Reason2024.12 | 0.141 | 0.895 |