Source Coverage Evaluation on DIVERSESUMM Augmented 1.0 (test)
0.5535Source CoverageLLM + DPP
Evaluation Results
| Method | Links | |
|---|---|---|
| LLM + DPPLLM=GPT-4o2025.05 | 0.5535 | |
| LLM + DPPLLM=Claude-3-Sonnet2025.05 | 0.5469 | |
| LLM-Selected KPsLLM=GPT-4o2025.05 | 0.5409 | |
| LLM-Selected KPsLLM=Claude-3-Sonnet2025.05 | 0.5142 | |
| Naive LLMLLM=GPT-4o2025.05 | 0.4807 | |
| All KPsLLM=GPT-4o2025.05 | 0.462 | |
| Naive LLMLLM=Claude-3-Sonnet2025.05 | 0.4248 | |
| All KPsLLM=Claude-3-Sonnet2025.05 | 0.4114 | |
| LLM-Selected KPsLLM=GPT-3.52025.05 | 0.3849 | |
| LLM + DPPLLM=GPT-3.52025.05 | 0.3845 | |
| LLM + DPPLLM=Llama-3.12025.05 | 0.3227 | |
| LLM-Selected KPsLLM=Llama-3.12025.05 | 0.3087 | |
| Naive LLMLLM=GPT-3.52025.05 | 0.2667 | |
| All KPsLLM=GPT-3.52025.05 | 0.2573 | |
| All KPsLLM=Llama-3.12025.05 | 0.2368 | |
| Naive LLMLLM=Llama-3.12025.05 | 0.2187 |