Dialogue Relation Extraction on DialogRE (test)
77.1F1HiDialog
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HiDialogencoder=RoBERTa2023.04 | 77.1 | 68.2 | |
| HiDialogbase_model=RoBERTa_s2023.04 | 74.4 | 66.6 | |
| TUCORE-GCN2023.04 | 73.1 | 65.9 | |
| TUCORE-GCN_RoBERTaBackbone=RoBERTa2021.09 | 73.1 | 65.9 | |
| RoBERTaencoder=RoBERTa2023.04 | 71.3 | 63.7 | |
| RoBERTa_s2023.04 | 71.3 | 63.7 | |
| RoBERTa_sBackbone=RoBERTa, Variant=s2021.09 | 71.3 | 63.7 | |
| KnowPromptExtra Data=w/o, Backbone=RoBERTa, Learning Paradigm=Prompt-tuning2021.04 | 68.6 | — | |
| DUALExtra Data=w/o, Learning Paradigm=Fine-tuning2021.04 | 67.3 | — | |
| SimpleREthreshold τ=0.6, maximal refinement iterations B=32020.12 | 66.3 | — | |
| TUCORE-GCN_BERTBackbone=BERT2021.09 | 65.5 | 60.2 | |
| GDPNet2020.12 | 64.9 | — | |
| GDPNETExtra Data=w/o, Learning Paradigm=Fine-tuning2021.04 | 64.9 | — | |
| PTRExtra Data=w/o, Backbone=RoBERTa, Learning Paradigm=Prompt-tuning2021.04 | 63.2 | — | |
| GRASPlargeApproach type=Prompt-based fine-tuning approach, Shot (K)=322022.08 | 62.6 | — | |
| BERT_s + SIEFBase Model=BERT_s2022.04 | 61.8 | 58.4 | |
| BERT_sBase Model=BERT_s2022.04 | 61.2 | 55.4 | |
| BERTS2020.12 | 61.2 | — | |
| GDPNet2023.04 | 60.2 | 57.3 | |
| GDPNetBackbone=GDPNet, Note=re-implementation2021.09 | 60.2 | 57.3 | |
| BERT + SIEFBase Model=BERT2022.04 | 59.9 | 56.1 | |
| BERT_sBackbone=BERT, Variant=s2021.09 | 59.5 | 54.2 | |
| BERTBase Model=BERT2022.04 | 58.5 | 53.2 | |
| BERT2020.12 | 58.5 | — | |
| BERT2023.04 | 57.9 | 53.1 | |
| BERTBackbone=BERT2021.09 | 57.9 | 53.1 | |
| FINE-TUNINGExtra Data=w/o, Backbone=RoBERTa, Learning Paradigm=Fine-tuning2021.04 | 57.3 | — | |
| Heterogeneous Graph Attention Network (HGAT)#params=4.0M, Word embeddings=GloVe2020.09 | 56.1 | 50.7 | |
| DHGAT2020.12 | 56.1 | — | |
| GRASPbaseApproach type=Prompt-based fine-tuning approach, Shot (K)=322022.08 | 56 | — | |
| KnowPromptApproach type=Prompt-based fine-tuning approach, Shot (K)=322022.08 | 55.3 | — | |
| GRASPlargeApproach type=Prompt-based fine-tuning approach, Shot (K)=162022.08 | 55.3 | — | |
| KnowPromptK=322021.04 | 55.3 | — | |
| TUCORE-GCNApproach type=Fine-tuning based approach, Shot (K)=322022.08 | 53.8 | — | |
| GRASPbaseApproach type=Prompt-based fine-tuning approach, Shot (K)=162022.08 | 52 | — | |
| KnowPromptApproach type=Prompt-based fine-tuning approach, Shot (K)=162022.08 | 50.8 | — | |
| KnowPromptK=162021.04 | 50.8 | — | |
| GDPNetK=322021.04 | 50.2 | — | |
| RoBERTaApproach type=Fine-tuning based approach, Shot (K)=322022.08 | 49.7 | — | |
| Fine-tuningK=322021.04 | 49.7 | — | |
| PTRApproach type=Prompt-based fine-tuning approach, Shot (K)=322022.08 | 49.5 | — | |
| PTRK=322021.04 | 49.5 | — | |
| BiLSTM#params=4.1M, Word embeddings=GloVe2020.09 | 48.6 | 45 | |
| BILSTM2020.12 | 48.6 | — | |
| CNNWord embeddings=GloVe2020.09 | 48 | 45 | |
| CNN2020.12 | 48 | — | |
| LSTMWord embeddings=GloVe2020.09 | 47.4 | 44.9 | |
| LSTM2020.12 | 47.4 | — | |
| AGGCN#params=3.7M, Word embeddings=GloVe2020.09 | 46.2 | 39.5 | |
| AGGCN2020.12 | 46.2 | — | |
| GRASPbaseApproach type=Prompt-based fine-tuning approach, Shot (K)=82022.08 | 45.4 | — | |
| LSR#params=20.5M, Word embeddings=GloVe2020.09 | 44.4 | — | |
| LSR2020.12 | 44.4 | — | |
| KnowPromptApproach type=Prompt-based fine-tuning approach, Shot (K)=82022.08 | 43.8 | — | |
| KnowPromptK=82021.04 | 43.8 | — | |
| PTRApproach type=Prompt-based fine-tuning approach, Shot (K)=162022.08 | 43.5 | — | |
| PTRK=162021.04 | 43.5 | — | |
| GDPNetK=162021.04 | 42.5 | — | |
| RoBERTaApproach type=Fine-tuning based approach, Shot (K)=162022.08 | 40.8 | — | |
| Fine-tuningK=162021.04 | 40.8 | — | |
| TUCORE-GCNApproach type=Fine-tuning based approach, Shot (K)=162022.08 | 40 | — | |
| GRASPlargeApproach type=Prompt-based fine-tuning approach, Shot (K)=82022.08 | 36 | — | |
| MajorityWord embeddings=GloVe2020.09 | 35.8 | 35.8 | |
| PTRApproach type=Prompt-based fine-tuning approach, Shot (K)=82022.08 | 35.5 | — | |
| PTRK=82021.04 | 35.5 | — | |
| RoBERTaApproach type=Fine-tuning based approach, Shot (K)=82022.08 | 29.8 | — | |
| Fine-tuningK=82021.04 | 29.8 | — | |
| GDPNetK=82021.04 | 28.6 | — | |
| TUCORE-GCNApproach type=Fine-tuning based approach, Shot (K)=82022.08 | 24.6 | — | |
| SimpleRE2023.04 | — | 66.7 |