Keyphrase Extraction on DUC 2001
34.12F1 Score @ 5GPT-5
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5Backbone=GPT-5, Prompting Strategy=Candidate, Zero-shot evaluation=true2026.05 | 34.12 | 35.51 | 33.96 | |
| MUDYBackbone=Gemma22026.05 | 32.77 | 36.86 | 36 | |
| MUDYMethod Type=Prompt-based, Backbone=Gemma22026.05 | 32.77 | 36.86 | 36 | |
| EmpiricalMethod Type=Prompt-based, Backbone=Llama32026.05 | 30.43 | 32.31 | 29.76 | |
| Attention-SeekerMethod Type=Attention-based, Backbone=Llama32026.05 | 29.71 | 31.75 | 31.11 | |
| PromptRankMethod Type=Prompt-based, Backbone=Gemma22026.05 | 29.28 | 33.54 | 33.59 | |
| SAMRankMethod Type=Attention-based, Backbone=Llama32026.05 | 28.26 | 30.47 | 30.2 | |
| PromptRankModel=T52023.05 | 27.39 | 31.59 | 31.01 | |
| MUDYBackbone=T52026.05 | 26.99 | 31.95 | 31.97 | |
| MUDYMethod Type=Prompt-based, Backbone=T52026.05 | 26.99 | 31.95 | 31.97 | |
| GPT-5Backbone=GPT-5, Prompting Strategy=Vanilla, Zero-shot evaluation=true2026.05 | 26.57 | 26.27 | 23.75 | |
| JointGLMethod Type=Embedding-based, Backbone=BERT2026.05 | 26.03 | 28.76 | 29.07 | |
| SIFRankModel=ELMO2023.05 | 24.3 | 27.6 | 27.96 | |
| PromptRankMethod Type=Prompt-based, Backbone=T52026.05 | 23.71 | 28.38 | 28.43 | |
| MultipartiteRank2023.05 | 21.7 | 24.1 | 23.62 | |
| MultipartiteRankMethod Type=Graph-based2026.05 | 21.7 | 24.1 | 23.62 | |
| TopicRank2023.05 | 19.97 | 21.73 | 20.97 | |
| TopicRankMethod Type=Graph-based2026.05 | 19.97 | 21.73 | 20.97 | |
| SingleRank2023.05 | 19.14 | 23.86 | 23.43 | |
| SingleRankMethod Type=Graph-based2026.05 | 19.14 | 23.86 | 23.43 | |
| MDERankModel=BERT2023.05 | 13.05 | 17.31 | 19.13 | |
| MDERankMethod Type=Embedding-based, Backbone=BERT2026.05 | 13.05 | 17.31 | 19.13 | |
| YAKE2023.05 | 11.99 | 14.18 | 14.28 | |
| YAKEMethod Type=Statistic-based2026.05 | 11.99 | 14.18 | 14.28 | |
| TextRank2023.05 | 11.02 | 17.45 | 18.84 | |
| TextRankMethod Type=Graph-based2026.05 | 11.02 | 17.45 | 18.84 | |
| EmbedRankModel=BERT2023.05 | 8.12 | 11.62 | 13.58 | |
| EmbedRankMethod Type=Embedding-based, Backbone=BERT2026.05 | 8.12 | 11.62 | 13.58 |