Unsupervised Relation Extraction on T-REx DS (test)
42.9B3 F1Element Intervention
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Element InterventionBackbone=BERT-base-uncased, Number of clusters (K)=10, Hyber=true, Gcc=true2021.06 | 42.9 | 40.2 | 45.9 | 47.3 | 46.9 | 47.8 | 25 | |
| Element Intervention w/o GccBackbone=BERT-base-uncased, Number of clusters (K)=10, Hyber=true, Gcc=false2021.06 | 41.5 | 40.1 | 42.9 | 45.2 | 44.8 | 45.6 | 21.7 | |
| Element Intervention w/o HyberBackbone=BERT-base-uncased, Number of clusters (K)=10, Hyber=false, Gcc=true2021.06 | 40.9 | 39.2 | 42.7 | 43 | 42.5 | 43.6 | 22.4 | |
| SelfOREmodel=SelfORE2021.06 | 32.9 | 29.7 | 36.8 | 32.4 | 30.1 | 35.1 | 20.1 | |
| UIE-BERTmodel=UIE, Backbone=BERT2021.06 | 22.4 | 17.6 | 30.8 | 31.2 | 26.3 | 38.3 | 12.3 | |
| UIE-PCNNmodel=UIE, Backbone=PCNN2021.06 | 19.7 | 14 | 33.4 | 26.6 | 20.8 | 36.8 | 9.4 | |
| rel-LDA-fullmodel=rel-LDA2021.06 | 12.7 | 8.3 | 26.6 | 17 | 13.3 | 23.5 | 3.4 | |
| Marchmodel=March2021.06 | 9 | 6.4 | 15.5 | 5.7 | 4.5 | 7.9 | 1.9 |