Document-level Relation Extraction on Re-DocRED (test)
80.39Ignored F1 ScoreDREEAM
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DREEAMPLM encoder=RoBERTa-large, Distantly-Supervised Data=true, Inference-Stage Fusion=true2023.02 | 80.39 | 81.44 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KD-DocREPLM encoder=RoBERTa-large, Distantly-Supervised Data=true2023.02 | 80.32 | 81.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DREEAMPLM encoder=RoBERTa-large, Distantly-Supervised Data=false, Inference-Stage Fusion=true2023.02 | 79.66 | 80.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DREEAMPLM encoder=RoBERTa-large, Distantly-Supervised Data=true, Inference-Stage Fusion=false2023.02 | 78.67 | 79.35 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NCRL-RoBERTa_largeBackbone=RoBERTa-large, EVRT=false2024.06 | 78.57 | 79.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ATLOPPLM encoder=RoBERTa-large, Distantly-Supervised Data=true2023.02 | 78.52 | 79.46 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DocuNetPLM encoder=RoBERTa-large, Distantly-Supervised Data=true2023.02 | 78.52 | 79.46 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KD-DocRE-RoBERTa_largeBackbone=RoBERTa-large, EVRT=false2024.06 | 77.98 | 78.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KD-DocREPLM encoder=RoBERTa-large, Distantly-Supervised Data=false2023.02 | 77.6 | 78.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DocuNet-RoBERTa_largeBackbone=RoBERTa-large, EVRT=false2024.06 | 77.43 | 78.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DREEAMPLM encoder=RoBERTa-large, Distantly-Supervised Data=false, Inference-Stage Fusion=false2023.02 | 77.34 | 77.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DocuNetPLM encoder=RoBERTa-large, Distantly-Supervised Data=false2023.02 | 77.26 | 77.87 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ATLOPPLM encoder=RoBERTa-large, Distantly-Supervised Data=false2023.02 | 76.82 | 77.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NCRL-RoBERTa_large + EVRTBackbone=RoBERTa-large, EVRT=true2024.06 | 76.78 | 77.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KD-DocRE-RoBERTa_large + EVRTBackbone=RoBERTa-large, EVRT=true2024.06 | 76.2 | 76.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DocuNet-RoBERTa_large + EVRTBackbone=RoBERTa-large, EVRT=true2024.06 | 76.07 | 76.68 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KD-DocRE-BERT_baseBackbone=BERT-base, EVRT=false2024.06 | 73.22 | 74 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NCRL-BERT_baseBackbone=BERT-base, EVRT=false2024.06 | 72.99 | 73.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DocuNet-BERT_baseBackbone=BERT-base, EVRT=false2024.06 | 72.5 | 73.32 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KD-DocRE-BERT_base + EVRTBackbone=BERT-base, EVRT=true2024.06 | 72.41 | 73.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NCRL-BERT_base + EVRTBackbone=BERT-base, EVRT=true2024.06 | 72 | 72.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DocuNet-BERT_base + EVRTBackbone=BERT-base, EVRT=true2024.06 | 71.64 | 72.44 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DREEAM-RoBERTaDistant Data=UGDRE2026.01 | 62.16 | 65.99 | 75.97 | 69.29 | 61.64 | — | — | — | — | — | — | — | — | — | — | |
| DREEAM-RoBERTaDistant Data=D+U (DOREMI for long tail, UGDRE for frequent relations)2026.01 | 59.83 | 63.06 | 79.63 | 73.11 | 55.22 | — | — | — | — | — | — | — | — | — | — | |
| DREEAM-BERTDistant Data=UGDRE2026.01 | 58.43 | 62.53 | 72.38 | 65.28 | 58.13 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-RoBERTaDistant Data=UGDRE2026.01 | 57.74 | 63.58 | 70.64 | 61.95 | 60.75 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-RoBERTaDistant Data=D+U (DOREMI for long tail, UGDRE for frequent relations)2026.01 | 57.6 | 62.45 | 73.02 | 65 | 57.6 | — | — | — | — | — | — | — | — | — | — | |
| DREEAM-RoBERTaDistant Data=DOREMI2026.01 | 57.25 | 62.6 | 76.05 | 65.91 | 56.61 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-BERTDistant Data=UGDRE2026.01 | 57.02 | 62.64 | 70.88 | 61.89 | 59.7 | — | — | — | — | — | — | — | — | — | — | |
| DREEAM-BERTDistant Data=D+U (DOREMI for long tail, UGDRE for frequent relations)2026.01 | 56.49 | 60.13 | 76.28 | 69.9 | 52.32 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-BERTDistant Data=D+U (DOREMI for long tail, UGDRE for frequent relations)2026.01 | 56.41 | 61.07 | 73.88 | 65.78 | 54.9 | — | — | — | — | — | — | — | — | — | — | |
| DREEAM-BERTDistant Data=DOREMI2026.01 | 53.87 | 59.18 | 71 | 61.1 | 54 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-BERTDistant Data=DOREMI2026.01 | 51.81 | 57.81 | 69.22 | 58.01 | 53.54 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-RoBERTaDistant Data=DOREMI2026.01 | 51.5 | 56.99 | 69.51 | 58.85 | 52.75 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-RoBERTaDistant Data=DocRED2026.01 | 33.93 | 39.83 | 66.91 | 52.18 | 33.54 | — | — | — | — | — | — | — | — | — | — | |
| DREEAM-RoBERTaDistant Data=DocRED2026.01 | 32.45 | 36.33 | 76.42 | 64.53 | 28.34 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-BERTDistant Data=DocRED2026.01 | 30.75 | 36.98 | 66.14 | 50.93 | 30.16 | — | — | — | — | — | — | — | — | — | — | |
| DREEAM-BERTDistant Data=DocRED2026.01 | 28.26 | 32.36 | 75.48 | 60.4 | 24.61 | — | — | — | — | — | — | — | — | — | — | |
| ATLOP-DOREMICategory=BERT2026.01 | — | — | — | — | — | 74.8 | 0.6297 | 69.14 | 71.86 | 0.6591 | 60.23 | 0.5004 | 36.28 | 42.99 | 0.3795 | |
| ATLOP-DOREMICategory=RoBERTa2026.01 | — | — | — | — | — | 74.86 | 0.6311 | 70.23 | 72.47 | 0.6648 | 62.32 | 0.5315 | 34.89 | 42.06 | 0.3784 | |
| DREEAM-DOREMICategory=BERT2026.01 | — | — | — | — | — | 77.01 | 0.6576 | 70.37 | 73.54 | 0.6799 | 72.5 | 0.664 | 42.1 | 53.26 | 0.5153 | |
| DREEAM-DOREMICategory=RoBERTa2026.01 | — | — | — | — | — | 79.39 | 0.6894 | 72.67 | 75.88 | 0.7075 | 75.75 | 0.7032 | 44.98 | 56.44 | 0.5486 | |
| GPT-4.1Category=LLMs, Prompting=zero-shot2026.01 | — | — | — | — | — | 16.12 | — | 3.01 | 5.79 | — | 0.93 | — | 1.53 | 1.16 | — | |
| Llama-3.3-70BCategory=LLMs, Prompting=zero-shot2026.01 | — | — | — | — | — | 1.98 | — | 0.15 | 0.28 | — | 0 | — | 0 | 0 | — |