# Query-focused Multi-document Summarization on DIVERSESUMM Relevance Source: [Query-focused Multi-document Summarization on DIVERSESUMM Relevance]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:40:02.045Z Evaluation of query-focused multi-document summarization performance on the DIVERSESUMM Relevance dataset, measured using metrics such as Coverage. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Query-focused Multi-document Summarization | | Dataset (including any stated split) | DIVERSESUMM Relevance | | Metric | Coverage | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Coverage](): Higher is better; unit: PERCENT. ## Recorded results | Method | Coverage | Result date | Report paper | | --- | --- | --- | --- | | LLM + DPP-Relevance | 69.72 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM + DPP-Relevance | 69.37 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM + DPP | 66.72 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM + DPP | 66.05 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM-Selected KPs | 64.43 | Not recorded | 68fa78d71e209131cea7ab57 | | Naive LLM | 64.1 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM-Selected KPs | 61.8 | Not recorded | 68fa78d71e209131cea7ab57 | | Naive LLM | 58.43 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM + DPP-Relevance | 54.09 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM-Selected KPs | 52.92 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM + DPP | 52.29 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM + DPP-Relevance | 45.01 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM + DPP | 42.24 | Not recorded | 68fa78d71e209131cea7ab57 | | Naive LLM | 40.8 | Not recorded | 68fa78d71e209131cea7ab57 | | LLM-Selected KPs | 36.03 | Not recorded | 68fa78d71e209131cea7ab57 | | Naive LLM | 31.82 | Not recorded | 68fa78d71e209131cea7ab57 | ### LLM + DPP-Relevance Coverage: 69.72. Result ID: 6995a57e3badfaffe6a2fb31. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"GPT 4o"}. This record does not assert independent reproduction. ### LLM + DPP-Relevance Coverage: 69.37. Result ID: 6995a57e3badfaffe6a2fb32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"Claude"}. This record does not assert independent reproduction. ### LLM + DPP Coverage: 66.72. Result ID: 6995a57e3badfaffe6a2fb2e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"Claude"}. This record does not assert independent reproduction. ### LLM + DPP Coverage: 66.05. Result ID: 6995a57e3badfaffe6a2fb2d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"GPT 4o"}. This record does not assert independent reproduction. ### LLM-Selected KPs Coverage: 64.43. Result ID: 6995a57e3badfaffe6a2fb29. [Reporting paper]() Recorded evaluation configuration: {"LLM Model":"GPT 4o"}. This record does not assert independent reproduction. ### Naive LLM Coverage: 64.1. Result ID: 6995a57e3badfaffe6a2fb25. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"GPT 4o"}. This record does not assert independent reproduction. ### LLM-Selected KPs Coverage: 61.8. Result ID: 6995a57e3badfaffe6a2fb2a. [Reporting paper]() Recorded evaluation configuration: {"LLM Model":"Claude"}. This record does not assert independent reproduction. ### Naive LLM Coverage: 58.43. Result ID: 6995a57e3badfaffe6a2fb26. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"Claude"}. This record does not assert independent reproduction. ### LLM + DPP-Relevance Coverage: 54.09. Result ID: 6995a57e3badfaffe6a2fb30. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"GPT 3.5"}. This record does not assert independent reproduction. ### LLM-Selected KPs Coverage: 52.92. Result ID: 6995a57e3badfaffe6a2fb28. [Reporting paper]() Recorded evaluation configuration: {"LLM Model":"GPT 3.5"}. This record does not assert independent reproduction. ### LLM + DPP Coverage: 52.29. Result ID: 6995a57e3badfaffe6a2fb2c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"GPT 3.5"}. This record does not assert independent reproduction. ### LLM + DPP-Relevance Coverage: 45.01. Result ID: 6995a57e3badfaffe6a2fb33. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"Llama"}. This record does not assert independent reproduction. ### LLM + DPP Coverage: 42.24. Result ID: 6995a57e3badfaffe6a2fb2f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"Llama"}. This record does not assert independent reproduction. ### Naive LLM Coverage: 40.8. Result ID: 6995a57e3badfaffe6a2fb24. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"GPT 3.5"}. This record does not assert independent reproduction. ### LLM-Selected KPs Coverage: 36.03. Result ID: 6995a57e3badfaffe6a2fb2b. [Reporting paper]() Recorded evaluation configuration: {"LLM Model":"Llama"}. This record does not assert independent reproduction. ### Naive LLM Coverage: 31.82. Result ID: 6995a57e3badfaffe6a2fb27. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Model":"Llama"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.