Source Coverage Evaluation on DIVERSESUMM 1.0 (test)
59.23Source CoverageLLM + DPP
Evaluation results
| Method | Links | |
|---|---|---|
| LLM + DPPLLM=Claude-3-Sonnet2025.05 | 59.23 | |
| LLM + DPPLLM=GPT-4o2025.05 | 58.05 | |
| LLM-Selected KPsLLM=GPT-4o2025.05 | 57.47 | |
| All KPsLLM=Claude-3-Sonnet2025.05 | 56.83 | |
| Naive LLMLLM=GPT-4o2025.05 | 55.16 | |
| All KPsLLM=GPT-4o2025.05 | 54.43 | |
| LLM-Selected KPsLLM=Claude-3-Sonnet2025.05 | 53.69 | |
| Naive LLMLLM=Claude-3-Sonnet2025.05 | 47.76 | |
| LLM + DPPLLM=GPT-3.52025.05 | 47.06 | |
| LLM-Selected KPsLLM=GPT-3.52025.05 | 43.7 | |
| LLM + DPPLLM=Llama-3.12025.05 | 36.53 | |
| All KPsLLM=GPT-3.52025.05 | 34.72 | |
| All KPsLLM=Llama-3.12025.05 | 34.58 | |
| LLM-Selected KPsLLM=Llama-3.12025.05 | 33.76 | |
| Naive LLMLLM=GPT-3.52025.05 | 33.24 | |
| Naive LLMLLM=Llama-3.12025.05 | 24.27 |