Document Relation Extraction on ReDocRED (dev)
83.56F1 ScoreTTM-RE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| TTM-RETraining Setting=Human + Distant2024.06 | 83.56 | 83.01 | 88.09 | 81.78 | |
| SSR-PUTraining Setting=Human + Distant2024.06 | 80.09 | 78.26 | 74.51 | 84.83 | |
| DREEAMTraining Setting=Human Annotation Only2024.06 | 79.42 | 78.36 | 74.74 | 85.15 | |
| DREEAMTraining Setting=Human + Distant2024.06 | 79.29 | 78.89 | 74.61 | 85.15 | |
| KD-DocRETraining Setting=Human + Distant2024.06 | 78.62 | 77.15 | 80.89 | 73.02 | |
| SSR-PUTraining Setting=Human Annotation Only2024.06 | 78.58 | 78.08 | 75.59 | 86.89 | |
| TTM-RETraining Setting=Human Annotation Only2024.06 | 78.13 | 78.05 | 83.28 | 76.28 | |
| KD-DocRETraining Setting=Human Annotation Only2024.06 | 77.88 | 77.12 | 85.16 | 71.3 | |
| TTM-RETraining Setting=Human + Distant, Variant=PU2024.06 | 77.1 | 76.85 | 73.39 | 80.94 | |
| ATLOPTraining Setting=Human Annotation Only2024.06 | 76.15 | 75.88 | 69.62 | 84.26 | |
| ATLOPTraining Setting=Human + Distant2024.06 | 75.87 | 74.83 | 70.81 | 80.67 | |
| TTM-RETraining Setting=Distant Only2024.06 | 42.21 | 39.79 | 27.68 | 81.7 | |
| TTM-RETraining Setting=Distant Only, Variant=PU2024.06 | 41.83 | 48.83 | 39.79 | 74.32 | |
| ATLOPTraining Setting=Distant Only2024.06 | 40.42 | 32.14 | 31.11 | 60.3 | |
| SSR-PUTraining Setting=Distant Only2024.06 | 39.35 | 35.04 | 23.35 | 72.63 |