Relation Extraction on DocRED official (dev)
67.41F1 ScoreDREEAM (student)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DREEAM (student)PLM=RoBERTalarge, Distantly-Supervised Data=true, Inference-Stage Fusion=true2023.02 | 67.41 | 65.52 | |
| KD-DocREPLM=RoBERTalarge, Distantly-Supervised Data=true, Inference-Stage Fusion=false2023.02 | 67.12 | 65.27 | |
| DREEAM (student)PLM=RoBERTalarge, Distantly-Supervised Data=true, Inference-Stage Fusion=false2023.02 | 67.09 | 65.24 | |
| DREEAM (student)PLM=BERTbase, Distantly-Supervised Data=true, Inference-Stage Fusion=true2023.02 | 65.83 | 63.92 | |
| SSANPLM=RoBERTalarge, Distantly-Supervised Data=true, Inference-Stage Fusion=false2023.02 | 65.69 | 63.76 | |
| DREEAM (student)PLM=BERTbase, Distantly-Supervised Data=true, Inference-Stage Fusion=false2023.02 | 65.3 | 63.47 | |
| SAISPLM=RoBERTalarge, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 65.17 | 62.23 | |
| KD-DocREPLM=BERTbase, Distantly-Supervised Data=true, Inference-Stage Fusion=false2023.02 | 64.81 | 63.38 | |
| EIDERPLM=RoBERTalarge, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 64.27 | 62.34 | |
| DREEAM (teacher)PLM=RoBERTalarge, Distantly-Supervised Data=false, Inference-Stage Fusion=true2023.02 | 64.2 | 62.29 | |
| DocuNet-RoBERTalargeEncoder=RoBERTa-large2021.06 | 64.12 | 62.23 | |
| DocuNetPLM=RoBERTalarge, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 64.12 | 62.23 | |
| DREEAM (teacher)PLM=RoBERTalarge, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 63.49 | 61.71 | |
| ATLOP-RoBERTalargeEncoder=RoBERTa-large2021.06 | 63.18 | 61.32 | |
| ATLOPPLM=RoBERTalarge, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 63.18 | 61.32 | |
| SAISPLM=BERTbase, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 62.96 | 59.98 | |
| DREEAM (teacher)PLM=BERTbase, Distantly-Supervised Data=false, Inference-Stage Fusion=true2023.02 | 62.55 | 60.51 | |
| EIDERPLM=BERTbase, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 62.48 | 60.51 | |
| SSANPLM=RoBERTalarge, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 62.08 | 60.25 | |
| DocuNet-BERTbaseEncoder=BERT-base2021.06 | 61.83 | 59.86 | |
| DocuNetPLM=BERTbase, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 61.83 | 59.86 | |
| DREEAM (teacher)PLM=BERTbase, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 61.42 | 59.6 | |
| GAIN-BERTBASEEncoder=BERT-base2021.06 | 61.22 | 59.14 | |
| ATLOP-BERTbaseEncoder=BERT-base2021.06 | 61.09 | 59.22 | |
| ATLOPPLM=BERTbase, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 61.09 | 59.22 | |
| HeterGSAN-BERTbaseEncoder=BERT-base2021.06 | 60.18 | 58.13 | |
| CorefRoBERTalargeEncoder=RoBERTa-large2021.06 | 59.43 | 57.35 | |
| RoBERTalargeEncoder=RoBERTa-large2021.06 | 59.22 | 57.14 | |
| SSANPLM=BERTbase, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 59.19 | 57.03 | |
| CorefBERTlargeEncoder=BERT-large2021.06 | 59.01 | 56.82 | |
| LSR-BERTbaseEncoder=BERT-base2021.06 | 59 | 52.43 | |
| BERTlargeEncoder=BERT-large2021.06 | 58.83 | 56.67 | |
| E2GREPLM=BERTbase, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 58.72 | 55.22 | |
| CorefBERTbaseEncoder=BERT-base2021.06 | 57.51 | 55.32 | |
| HIN-BERTbaseEncoder=BERT-base2021.06 | 56.31 | 54.29 | |
| GEDA-BERTbaseEncoder=BERT-base2021.06 | 56.16 | 54.52 | |
| BERT-TSbaseEncoder=BERT-base2021.06 | 54.42 | — | |
| BERTbaseEncoder=BERT-base2021.06 | 54.16 | — |