Scientific Summarization on PMC-Large 500-example (test)
0.839Overall ScoreAgg-All
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Agg-AllSelection Strategy=Aggregate selection, Subset Size=5K, Selection Pool=Top 10K AlignScore pool2026.06 | 0.839 | 0.876 | 0.406 | 0.861 | 0.961 | 93.6 | |
| Agg-NoSummaCSelection Strategy=Aggregate selection, Subset Size=2K, Selection Pool=Top 10K AlignScore pool2026.06 | 0.786 | 0.879 | 0.401 | 0.864 | 0.957 | 96.2 | |
| Agg-NoSummaCSelection Strategy=Aggregate selection, Subset Size=5K, Selection Pool=Top 10K AlignScore pool2026.06 | 0.75 | 0.876 | 0.399 | 0.867 | 0.958 | 95.2 | |
| AlignScoreSelection Strategy=AlignScore, Subset Size=5K, Selection Pool=100K2026.06 | 0.679 | 0.883 | 0.398 | 0.849 | 0.957 | 95.4 | |
| Agg-AllSelection Strategy=Aggregate selection, Subset Size=2K, Selection Pool=Top 10K AlignScore pool2026.06 | 0.679 | 0.877 | 0.401 | 0.855 | 0.954 | 94.6 | |
| AlignScoreSelection Strategy=AlignScore, Subset Size=1K, Selection Pool=100K2026.06 | 0.625 | 0.887 | 0.405 | 0.824 | 0.949 | 95.8 | |
| AlignScoreSelection Strategy=AlignScore, Subset Size=10K, Selection Pool=100K2026.06 | 0.589 | 0.866 | 0.397 | 0.868 | 0.947 | 94.4 | |
| AlignScoreSelection Strategy=AlignScore, Subset Size=2K, Selection Pool=100K2026.06 | 0.571 | 0.879 | 0.395 | 0.841 | 0.957 | 95 | |
| Agg-AllSelection Strategy=Aggregate selection, Subset Size=1K, Selection Pool=Top 10K AlignScore pool2026.06 | 0.536 | 0.867 | 0.4 | 0.852 | 0.947 | 94.2 | |
| All 100KSelection Strategy=None (Full Dataset), Subset Size=100K, Selection Pool=100K2026.06 | 0.429 | 0.828 | 0.391 | 0.874 | 0.935 | 95.2 | |
| Agg-NoSummaCSelection Strategy=Aggregate selection, Subset Size=1K, Selection Pool=Top 10K AlignScore pool2026.06 | 0.429 | 0.864 | 0.392 | 0.856 | 0.945 | 94.4 | |
| RandomSelection Strategy=Random, Subset Size=10K, Selection Pool=100K2026.06 | 0.25 | 0.833 | 0.39 | 0.848 | 0.917 | 94.2 | |
| RandomSelection Strategy=Random, Subset Size=5K, Selection Pool=100K2026.06 | 0.179 | 0.825 | 0.392 | 0.843 | 0.913 | 93.8 | |
| RandomSelection Strategy=Random, Subset Size=2K, Selection Pool=100K2026.06 | 0.125 | 0.816 | 0.384 | 0.846 | 0.916 | 95 | |
| RandomSelection Strategy=Random, Subset Size=1K, Selection Pool=100K2026.06 | 0.036 | 0.81 | 0.388 | 0.838 | 0.906 | 94.8 |