Document-level Relation Extraction on Re-DocRED 1.0 (test)
79.03Overall F1 ScoreVaeDiff-DocRE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VaeDiff-DocREPLM=RoBERTaLarge2024.12 | 79.03 | 78.22 | 81.84 | 74.73 | |
| KD-DocREPLM=RoBERTaLarge2024.12 | 78.28 | 77.6 | 80.85 | 74.31 | |
| DocuNETPLM=RoBERTaLarge2024.12 | 77.87 | 77.26 | 81.25 | 73.32 | |
| ATLOPPLM=RoBERTaLarge2024.12 | 77.56 | 76.82 | 80.78 | 72.29 | |
| ATLOPPLM=BERTbase2024.12 | 75.92 | 72.61 | 67.46 | — | |
| VaeDiff-DocREPLM=BERTbase2024.12 | 75.07 | 74.13 | 78.32 | 70.06 | |
| KD-DocREPLM=BERTbase2024.12 | 74.88 | 73.98 | 78.28 | 69.52 | |
| CASTPLM=BERTbase2024.12 | 74.67 | 73.32 | 78.53 | 69.34 | |
| LMRCPLM=LLaMA2-13B-Chat2024.12 | 74.63 | 74.08 | — | — | |
| NRCLPLM=BERTbase2024.12 | 74.48 | 73.4 | 77.53 | 69.59 | |
| KMGREPLM=BERTbase2024.12 | 74.46 | 73.39 | — | — | |
| PEMSCLPLM=BERTbase2024.12 | 74.14 | 73.05 | 77.77 | 68.38 | |
| GAINPLM=BERTbase2024.12 | 73.44 | 71.88 | 73.35 | 74.22 | |
| JEREXPLM=RoBERTaLarge2024.12 | 72.57 | 71.45 | 77.09 | 66.31 | |
| BiLSTMPLM=N/A2024.12 | 59.93 | 57.84 | — | — | |
| LSTMPLM=N/A2024.12 | 57.83 | 56.31 | — | — | |
| CNNPLM=N/A2024.12 | 54.88 | 52.8 | — | — | |
| AutoREPLM=Vicuna-7B2024.12 | 53.84 | — | — | — | |
| ZeroDocREPLM=LLaMA2-13B-Chat2024.12 | 49.21 | — | — | — | |
| ZeroDocRTEPLM=LLaMA2-13B-Chat2024.12 | 13.23 | — | — | — | |
| GPT-3.5 + NLIPLM=GPT-3.52024.12 | — | 9.33 | — | — |