Unsupervised Relation Extraction on T-REx SPO (test)
45B3 F1Element Intervention
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Element InterventionBackbone=BERT-base-uncased, Number of clusters (K)=10, Hyber=true, Gcc=true2021.06 | 45 | 46.7 | 43.4 | 45.3 | 45.4 | 45.2 | 36.6 | |
| Element Intervention w/o GccBackbone=BERT-base-uncased, Number of clusters (K)=10, Hyber=true, Gcc=false2021.06 | 42.2 | 44.2 | 40.4 | 45.2 | 44.7 | 45.7 | 34.7 | |
| Element Intervention w/o HyberBackbone=BERT-base-uncased, Number of clusters (K)=10, Hyber=false, Gcc=true2021.06 | 41.4 | 40.9 | 42 | 43.7 | 42.3 | 45.2 | 33.2 | |
| SelfOREmodel=SelfORE2021.06 | 41 | 39.4 | 42.8 | 41.4 | 40.3 | 42.5 | 33.7 | |
| UIE-BERTmodel=UIE, Backbone=BERT2021.06 | 38.1 | 30.7 | 50.3 | 39.1 | 37.6 | 40.8 | 23.5 | |
| UIE-PCNNmodel=UIE, Backbone=PCNN2021.06 | 36.3 | 28.4 | 50.3 | 41.4 | 33.7 | 53.6 | 21.3 | |
| Marchmodel=March2021.06 | 24.8 | 20.6 | 31.3 | 23.6 | 19.1 | 30.6 | 12.6 | |
| rel-LDA-fullmodel=rel-LDA2021.06 | 18.5 | 14.3 | 26.1 | 19.4 | 16.1 | 24.5 | 8.6 |