Multi-document Summarization on MDS
1,681.6LengthVANILLA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VANILLALAQuer Protocol=None2025.06 | 1,681.6 | — | — | — | 0 | 82.2 | 84.5 | |
| ALCELAQuer Protocol=None2025.06 | 979.1 | — | — | — | 5.2 | 67.4 | 74.8 | |
| ALCELearning Setting=In-context Learning (ICL)2024.03 | 843.6 | 20.3 | 86.1 | 88.7 | 3.4 | — | — | |
| ATTR. FIRSTLearning Setting=In-context Learning (ICL)2024.03 | 92.7 | 16.7 | 85.2 | 79.5 | 0 | — | — | |
| ATTR. FIRST (CoT)Learning Setting=In-context Learning (ICL), Chain-of-Thought=true2024.03 | 75.3 | 19.5 | 86.1 | 72.8 | 1.5 | — | — | |
| ATTR. FIRST (joint)Learning Setting=Fine-tuned (FT), Training Mode=joint2024.03 | 57.1 | 18 | 85.3 | 48.9 | 0 | — | — | |
| LAQuerBase Method=ALCE, LAQuer Protocol=LLM Prompt2025.06 | 41.6 | — | — | — | 5.2 | 55.8 | 44.3 | |
| ATTR. FIRSTLearning Setting=Fine-tuned (FT)2024.03 | 33.1 | 16.5 | 84.9 | 64.4 | 0 | — | — | |
| ATTR. FIRSTLAQuer Protocol=None2025.06 | 33 | — | — | — | 0.4 | 80.3 | 58 | |
| LAQuerBase Method=VANILLA, LAQuer Protocol=LLM Prompt2025.06 | 32 | — | — | — | 0 | 62.5 | 49.7 | |
| LAQuerBase Method=ALCE, LAQuer Protocol=LLM Internals2025.06 | 29.9 | — | — | — | 8.2 | 15.5 | 10.2 | |
| LAQuerBase Method=VANILLA, LAQuer Protocol=LLM Internals2025.06 | 28.1 | — | — | — | 0 | 18 | 13.1 | |
| LAQuerBase Method=ATTR. FIRST, LAQuer Protocol=LLM Prompt2025.06 | 14.6 | — | — | — | 0.4 | 71.5 | 42.4 | |
| LAQuerBase Method=ATTR. FIRST, LAQuer Protocol=LLM Internals2025.06 | 12.2 | — | — | — | 21.4 | 28.6 | 13.2 | |
| GEMINILearning Setting=In-context Learning (ICL)2024.03 | — | 19 | 86.1 | — | — | — | — | |
| PRIMERALearning Setting=Fine-tuned (FT)2024.03 | — | 19.9 | 85.8 | — | — | — | — |