Timeline Summarization on Open-TLS
36.31Concat F1 (ROUGE-1)TimelineReasoner
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| TimelineReasonerModel=QwQ-32B2026.04 | 36.31 | 8.94 | 11.3 | 4 | 12.33 | 4.11 | 37.65 | |
| CHRONOSModel=Qwen2.5-72B2026.04 | 33.8 | 8.01 | 9.62 | 3.02 | 9.91 | 3.32 | 33.2 | |
| ITER_RAGModel=Qwen2.5-72B2026.04 | 32.92 | 7.62 | 5.79 | 2.01 | 6.33 | 2.11 | 19.02 | |
| CHRONOSModel=QwQ-32B2026.04 | 32.19 | 7.52 | 9.01 | 2.92 | 9.31 | 2.92 | 30.3 | |
| CHRONOSModel=Qwen2.5-32B2026.04 | 31.21 | 7.6 | 8.93 | 3.11 | 9.09 | 3.01 | 31.19 | |
| ITER_RAGModel=Qwen2.5-32B2026.04 | 30.4 | 7.02 | 4.99 | 1.8 | 5.68 | 1.88 | 19.01 | |
| ITER_RAGModel=QwQ-32B2026.04 | 29.19 | 6.39 | 5.22 | 1.83 | 5.7 | 1.84 | 18.93 | |
| DIRECTModel=Qwen2.5-72B2026.04 | 29.08 | 6.73 | 5.59 | 1.88 | 6.13 | 2.1 | 21.02 | |
| REWRITEModel=Qwen2.5-72B2026.04 | 28.94 | 7.4 | 6.08 | 3.02 | 6.49 | 3.08 | 19.93 | |
| REWRITEModel=QwQ-32B2026.04 | 28.62 | 6.09 | 5.27 | 1.7 | 5.8 | 1.79 | 18.92 | |
| REWRITEModel=Qwen2.5-32B2026.04 | 27.79 | 6.2 | 4.13 | 1.22 | 4.47 | 1.42 | 16.31 | |
| DIRECTModel=QwQ-32B2026.04 | 26.82 | 5.54 | 4.57 | 1.42 | 4.87 | 1.52 | 18.24 | |
| DIRECTModel=Qwen2.5-32B2026.04 | 26.11 | 5.87 | 3.82 | 1.31 | 4.08 | 1.38 | 14.73 |