News Headline Generation on LaMP-4 (random)
16.7ROUGE-1OPPU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OPPUInference Time (ms)=35.822025.10 | 16.7 | 14.8 | |
| P2PInference Time (ms)=39.982025.10 | 16 | 14.5 | |
| MT LoRAInference Time (ms)=30.512025.10 | 15 | 13.5 | |
| Full HistoryInference Time (ms)=461.832025.10 | 14.4 | 13.1 | |
| RAGInference Time (ms)=44.582025.10 | 13 | 11.8 | |
| PAGInference Time (ms)=66.852025.10 | 12.8 | 11.6 | |
| Base ModelInference Time (ms)=31.972025.10 | 12.1 | 10.8 |