Keyphrase Extraction on Inspec (test)
35.49F1@5Attention-Seeker
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Attention-Seeker2024.09 | 35.49 | — | 40.14 | 39.22 | |
| SAMRankModel=LLAMA 3-8B2024.09 | 34.25 | — | 38.18 | 38.11 | |
| PromptRank2024.09 | 31.73 | — | 37.88 | 38.17 | |
| EmbedRankEmbedding=doc2vec2024.09 | 31.51 | — | 37.94 | 37.96 | |
| JointGL2024.09 | 30.82 | — | 36.28 | 36.67 | |
| EmbedRankEmbedding=sent2vec2024.09 | 29.88 | — | 37.09 | 38.4 | |
| SIFRank2024.09 | 29.11 | — | 38.8 | 39.59 | |
| PositionRank2024.09 | 28.12 | — | 32.87 | 33.32 | |
| MDERank2024.09 | 27.85 | — | 34.36 | 36.4 | |
| SingleRank2024.09 | 27.79 | — | 34.46 | 36.05 | |
| TextRank2024.09 | 27.04 | — | 25.08 | 36.65 | |
| TopicRank2024.09 | 25.38 | — | 28.46 | 29.49 | |
| AttentionRank2024.09 | 24.45 | — | 32.15 | 34.49 | |
| YAKE2024.09 | 18.08 | — | 19.62 | 20.11 | |
| TF-IDF2024.09 | 11.28 | — | 13.88 | 13.83 | |
| BERTCategory=Text-based method2021.06 | — | 65.64 | — | — | |
| BiLSTM-CRFCategory=Text-based method2021.06 | — | 59.3 | — | — | |
| DeepWalkCategory=Graph-based method2021.06 | — | 31.9 | — | — | |
| ExEm_ftCategory=Graph-based method2021.06 | — | 32.86 | — | — | |
| ExEm_w2vCategory=Graph-based method2021.06 | — | 32.73 | — | — | |
| Node2vecCategory=Graph-based method2021.06 | — | 31.38 | — | — | |
| Phraseformer(BERT, DeepWalk)Category=Hybrid method, Base Text Model=BERT, Base Graph Model=DeepWalk2021.06 | — | 68.44 | — | — | |
| Phraseformer(BERT, ExEm_ft)Category=Hybrid method, Base Text Model=BERT, Base Graph Model=ExEm_ft2021.06 | — | 69.87 | — | — | |
| Phraseformer(BERT, ExEm_w2v)Category=Hybrid method, Base Text Model=BERT, Base Graph Model=ExEm_w2v2021.06 | — | 69.7 | — | — | |
| Phraseformer(BERT, Node2vec)Category=Hybrid method, Base Text Model=BERT, Base Graph Model=Node2vec2021.06 | — | 68.68 | — | — | |
| TextRankCategory=Graph-based method2021.06 | — | 17.8 | — | — | |
| Word2VecCategory=Text-based method2021.06 | — | 47.3 | — | — |