Literature Review Generation on SciReviewGen
56.7RelevanceQFiD
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| QFiDEvaluation results=Comparable2023.05 | 56.7 | — | — | — | 31.1 | 20 | 48.9 | 8.9 | — | — | — | — | — | — | — | — | |
| QFiDEvaluation results=Ground truth > Generated2023.05 | 25.6 | — | — | — | 48.9 | 64.4 | 40 | 68.9 | — | — | — | — | — | — | — | — | |
| QFiDEvaluation results=Generated > Ground truth2023.05 | 17.8 | — | — | — | 20 | 15.6 | 11.1 | 22.2 | — | — | — | — | — | — | — | — | |
| MASSSetting=Baseline2025.10 | 4.74 | — | — | — | — | — | — | — | — | 4.3 | 2.47 | 3.83 | — | — | — | — | |
| LiRASetting=Baseline2025.10 | 4.57 | — | — | — | — | — | — | — | — | 4.45 | 3.38 | 4.13 | — | — | — | — | |
| ASSetting=Baseline2025.10 | 4.55 | — | — | — | — | — | — | — | — | 4.5 | 2.3 | 3.78 | — | — | — | — | |
| DPSetting=Baseline2025.10 | 4.49 | — | — | — | — | — | — | — | — | 3.53 | 3.15 | 3.72 | — | — | — | — | |
| ASsetting=baseline2025.10 | — | — | — | — | — | — | — | — | — | — | — | — | 9 | 92 | 15 | 34 | |
| AS (AutoSurvey)setting=baseline2025.10 | — | — | — | — | — | — | — | — | 63 | — | — | — | — | — | — | — | |
| Big Bird2023.05 | — | 24.25 | 4.08 | 15.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPsetting=baseline2025.10 | — | — | — | — | — | — | — | — | 14 | — | — | — | — | — | — | — | |
| DPsetting=baseline2025.10 | — | — | — | — | — | — | — | — | — | — | — | — | 6 | 69 | 6 | 6 | |
| Ext-oracle2023.05 | — | 29.43 | 10.13 | 14.88 | — | — | — | — | — | — | — | — | — | — | — | — | |
| FiD2023.05 | — | 32.4 | 6.75 | 16.17 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LEAD2023.05 | — | 23.09 | 4.68 | 11.72 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LexRank2023.05 | — | 24.4 | 5.02 | 12.52 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LiRAsetting=baseline2025.10 | — | — | — | — | — | — | — | — | 76 | — | — | — | — | — | — | — | |
| LiRAsetting=baseline2025.10 | — | — | — | — | — | — | — | — | — | — | — | — | 13 | 82 | 10 | 27 | |
| MASSsetting=baseline2025.10 | — | — | — | — | — | — | — | — | 13 | — | — | — | — | — | — | — | |
| MASSsetting=baseline2025.10 | — | — | — | — | — | — | — | — | — | — | — | — | 9 | 66 | 5 | 9 | |
| QFiDbeam size=42023.05 | — | 34 | 7.75 | 16.52 | — | — | — | — | — | — | — | — | — | — | — | — |