List your company
ResearchFormerly WizWand

Keyphrase Extraction on Inspec (test)

35.49F1@5Attention-Seeker
10.311616.848323.38529.9217Sep 17, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Attention-Seeker2024.0935.49—40.1439.22
SAMRankModel=LLAMA 3-8B2024.0934.25—38.1838.11
PromptRank2024.0931.73—37.8838.17
EmbedRankEmbedding=doc2vec2024.0931.51—37.9437.96
JointGL2024.0930.82—36.2836.67
EmbedRankEmbedding=sent2vec2024.0929.88—37.0938.4
SIFRank2024.0929.11—38.839.59
PositionRank2024.0928.12—32.8733.32
MDERank2024.0927.85—34.3636.4
SingleRank2024.0927.79—34.4636.05
TextRank2024.0927.04—25.0836.65
TopicRank2024.0925.38—28.4629.49
AttentionRank2024.0924.45—32.1534.49
YAKE2024.0918.08—19.6220.11
TF-IDF2024.0911.28—13.8813.83
BERTCategory=Text-based method2021.06—65.64——
BiLSTM-CRFCategory=Text-based method2021.06—59.3——
DeepWalkCategory=Graph-based method2021.06—31.9——
ExEm_ftCategory=Graph-based method2021.06—32.86——
ExEm_w2vCategory=Graph-based method2021.06—32.73——
Node2vecCategory=Graph-based method2021.06—31.38——
Phraseformer(BERT, DeepWalk)Category=Hybrid method, Base Text Model=BERT, Base Graph Model=DeepWalk2021.06—68.44——
Phraseformer(BERT, ExEm_ft)Category=Hybrid method, Base Text Model=BERT, Base Graph Model=ExEm_ft2021.06—69.87——
Phraseformer(BERT, ExEm_w2v)Category=Hybrid method, Base Text Model=BERT, Base Graph Model=ExEm_w2v2021.06—69.7——
Phraseformer(BERT, Node2vec)Category=Hybrid method, Base Text Model=BERT, Base Graph Model=Node2vec2021.06—68.68——
TextRankCategory=Graph-based method2021.06—17.8——
Word2VecCategory=Text-based method2021.06—47.3——