Community Summary Evaluation on news C2 (post-cutoff)
56Comprehensiveness WinM2hC
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| M2hCHeuristic Level=L1, Evaluator LLM=GPT-3.5-turbo2026.03 | 56 | 34 | 10 | 44 | 52 | 4 | — | — | — | |
| M2hCHeuristic Level=LF, Evaluator LLM=GPT-3.5-turbo2026.03 | 54 | 38 | 8 | 56 | 42 | 2 | — | — | — | |
| RkHHeuristic Level=LF, Evaluator LLM=GPT-3.5-turbo2026.03 | 52 | 42 | 6 | 48 | 44 | 8 | — | — | — | |
| MRCHeuristic Level=L1, Evaluator LLM=GPT-3.5-turbo2026.03 | 50 | 42 | 8 | 62 | 38 | 0 | — | — | — | |
| RkHHeuristic Level=L1, Evaluator LLM=GPT-3.5-turbo2026.03 | 44 | 44 | 12 | 46 | 52 | 2 | — | — | — | |
| MRCHeuristic Level=LF, Evaluator LLM=GPT-3.5-turbo2026.03 | 42 | 48 | 10 | 52 | 48 | 0 | — | — | — | |
| M2hCHierarchy level=L1, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 63 | 35 | 2 | |
| M2hCHierarchy level=LF, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 46 | 51 | 3 | |
| MRCHierarchy level=L1, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 38 | 60 | 2 | |
| MRCHierarchy level=LF, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 50 | 40 | 10 | |
| RkHHierarchy level=L1, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 46 | 52 | 2 | |
| RkHHierarchy level=LF, Evaluation model=GPT-3.5-turbo2026.03 | — | — | — | — | — | — | 46 | 50 | 4 |