News Headline Generation on LaMP News
18.8RG1PURPLE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PURPLELLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 18.8 | 17.1 | 15.6 | |
| RankGPT (GPT-5-nano)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 18.7 | 17 | 15.8 | |
| ContrieverLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 18.6 | 17 | 15.6 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 18.3 | 16.8 | 15.3 | |
| BM25LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 18.1 | 16.5 | 14.9 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 18 | 16.5 | 15.2 | |
| DPSBackbone=LLaMA-3-8B2026.04 | 17.87 | 15.96 | 16.5 | |
| DeCoReBackbone=LLaMA-3-8B2026.04 | 17.68 | 15.72 | 16.26 | |
| PURPLELLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 17.6 | 15.9 | 15.3 | |
| ContrieverLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 17.2 | 15.6 | 15.1 | |
| RankGPT (GPT-5-nano)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 17.1 | 15.4 | 15 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 17.1 | 15.4 | 14.9 | |
| DoLaBackbone=LLaMA-3-8B2026.04 | 16.94 | 15.08 | 15.92 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 16.9 | 15.3 | 14.8 | |
| CADBackbone=LLaMA-3-8B2026.04 | 16.81 | 14.98 | 15.68 | |
| BM25LLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 16.7 | 15.1 | 14.7 | |
| DoLaBackbone=Qwen2-7B2026.04 | 16.42 | 14.73 | 12.72 | |
| DPSBackbone=Qwen2-7B2026.04 | 16.27 | 14.5 | 13.18 | |
| DeCoReBackbone=Qwen2-7B2026.04 | 15.81 | 13.05 | 12.32 | |
| CADBackbone=Qwen2-7B2026.04 | 15.8 | 13.92 | 12.55 | |
| DPSBackbone=Mistral-7B2026.04 | 15.36 | 13.66 | 13.99 | |
| REPLUGLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 15.2 | 13.9 | 12.1 | |
| PURPLELLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 15.1 | 13.5 | 12.6 | |
| ICR (Llama-3-8B-Instruct)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 15 | 13.4 | 12.5 | |
| REPLUGLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 14.8 | 13.2 | 11.8 | |
| IC-RALMLLM Backbone=Llama-3-70B-Instruct (70.6B)2026.01 | 14.8 | 13.3 | 12.2 | |
| RankGPT (Llama-3-8B-Instruct)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 14.7 | 13.1 | 12.3 | |
| ContrieverLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 14.6 | 13.1 | 12.2 | |
| RankGPT (GPT-5-nano)LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 14.6 | 13 | 12.1 | |
| BM25LLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 14.4 | 12.8 | 11.9 | |
| REPLUGLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 14.1 | 12.7 | 11.4 | |
| IC-RALMLLM Backbone=Llama-3-8B-Instruct (8.03B)2026.01 | 14.1 | 12.5 | 12.1 | |
| DoLaBackbone=Mistral-7B2026.04 | 13.62 | 11.36 | 9.62 | |
| CADBackbone=Mistral-7B2026.04 | 13.61 | 11.32 | 9.8 | |
| IC-RALMLLM Backbone=Phi-4-Mini-Instruct (3.84B)2026.01 | 13.4 | 11.9 | 11 | |
| DeCoReBackbone=Mistral-7B2026.04 | 12.99 | 10.85 | 9.08 |