Open-world Relation Extraction on FewRel (unlabeled)
86.06PrecisionMixORE
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| MixORE2025.05 | 86.06 | 80.67 | 83.28 | 95.85 | 84.26 | 89.68 | 94.9 | 82.06 | 88.02 | 88.17 | |
| KNORD2025.05 | 77.01 | 77.75 | 77.38 | 82.3 | 65.87 | 73.18 | 82.86 | 65.19 | 72.97 | 69.45 | |
| MatchPrompt'variant=prime2025.05 | 75.75 | 62.71 | 68.62 | 30.31 | 81.96 | 44.26 | 40.36 | 75.99 | 52.72 | 23.94 | |
| TABS'variant=prime2025.05 | 72.96 | 69.55 | 71.21 | 91.93 | 71.25 | 80.28 | 90.88 | 70.71 | 79.53 | 77.46 | |
| ORCA2025.05 | 60.95 | 63.28 | 62.1 | 63.47 | 48.23 | 54.81 | 63.35 | 48.48 | 54.92 | 43.18 | |
| AugURE*supervised cross-entropy=true, use_chatgpt=false2025.05 | 50.05 | 47.7 | 48.84 | 97.2 | 79.14 | 87.23 | 96.47 | 79.41 | 87.11 | 85.68 | |
| HiURE*supervised cross-entropy=true2025.05 | 44.41 | 42.6 | 43.49 | 96.6 | 81.47 | 88.38 | 96.15 | 80.42 | 87.58 | 87.35 |