Keyphrase Extraction on SemEval 2017
27.39F1@5MUDY
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MUDYBackbone=Gemma22026.05 | 27.39 | 38.36 | 41.84 | |
| MUDYMethod Type=Prompt-based, Backbone=Gemma22026.05 | 27.39 | 38.36 | 41.84 | |
| PromptRankMethod Type=Prompt-based, Backbone=Gemma22026.05 | 27.31 | 38.02 | 41.6 | |
| PromptRankModel=T52023.05 | 27.14 | 37.76 | 41.57 | |
| PromptRank2024.09 | 27.14 | 37.76 | 41.57 | |
| PromptRankMethod Type=Prompt-based, Backbone=T52026.05 | 27.07 | 37.83 | 41.82 | |
| MUDYBackbone=T52026.05 | 27.02 | 37.83 | 41.82 | |
| MUDYMethod Type=Prompt-based, Backbone=T52026.05 | 27.02 | 37.83 | 41.82 | |
| Attention-Seeker2024.09 | 25.4 | 34.53 | 38.5 | |
| Attention-SeekerMethod Type=Attention-based, Backbone=Llama32026.05 | 25.4 | 34.53 | 38.5 | |
| GPT-5Backbone=GPT-5, Prompting Strategy=Candidate, Zero-shot evaluation=true2026.05 | 25.19 | 35.85 | 40.37 | |
| SAMRankModel=LLAMA 3-8B2024.09 | 24.74 | 33.51 | 37.01 | |
| SAMRankMethod Type=Attention-based, Backbone=Llama32026.05 | 24.74 | 33.51 | 37.01 | |
| EmpiricalMethod Type=Prompt-based, Backbone=Llama32026.05 | 23.84 | 33.06 | 37.53 | |
| AttentionRank2024.09 | 23.59 | 34.37 | 38.21 | |
| MDERankModel=BERT2023.05 | 22.81 | 32.51 | 37.18 | |
| MDERankMethod Type=Embedding-based, Backbone=BERT2026.05 | 22.81 | 32.51 | 37.18 | |
| SIFRank2024.09 | 22.59 | 32.85 | 38.1 | |
| GPT-5Backbone=GPT-5, Prompting Strategy=Vanilla, Zero-shot evaluation=true2026.05 | 22.53 | 31.23 | 36.46 | |
| SIFRankModel=ELMO2023.05 | 22.38 | 32.6 | 37.25 | |
| JointGL2024.09 | 20.49 | 29.63 | 34.05 | |
| MDERank2024.09 | 20.37 | 31.21 | 36.63 | |
| EmbedRankEmbedding=doc2vec2024.09 | 20.21 | 29.59 | 33.94 | |
| EmbedRankModel=BERT2023.05 | 20.03 | 31.01 | 36.72 | |
| EmbedRankMethod Type=Embedding-based, Backbone=BERT2026.05 | 20.03 | 31.01 | 36.72 | |
| SingleRank2023.05 | 18.23 | 27.73 | 31.73 | |
| SingleRank2024.09 | 18.23 | 27.73 | 31.73 | |
| PositionRank2024.09 | 18.23 | 26.3 | 30.55 | |
| SingleRankMethod Type=Graph-based2026.05 | 18.23 | 27.73 | 31.73 | |
| JointGLMethod Type=Embedding-based, Backbone=BERT2026.05 | 18.05 | 26 | 29.27 | |
| MultipartiteRank2023.05 | 17.39 | 23.73 | 26.87 | |
| MultipartiteRankMethod Type=Graph-based2026.05 | 17.39 | 23.73 | 26.87 | |
| TopicRank2023.05 | 17.1 | 22.62 | 24.87 | |
| TopicRank2024.09 | 17.1 | 22.62 | 24.87 | |
| TopicRankMethod Type=Graph-based2026.05 | 17.1 | 22.62 | 24.87 | |
| TextRank2023.05 | 16.43 | 25.83 | 30.5 | |
| TextRank2024.09 | 16.43 | 25.83 | 30.5 | |
| TextRankMethod Type=Graph-based2026.05 | 16.43 | 25.83 | 30.5 | |
| TF-IDF2024.09 | 12.7 | 16.26 | 16.73 | |
| YAKE2023.05 | 11.84 | 18.14 | 20.55 | |
| YAKE2024.09 | 11.84 | 18.14 | 20.55 | |
| YAKEMethod Type=Statistic-based2026.05 | 11.84 | 18.14 | 20.55 |