Relation Extraction on ADE (10-fold CV)
83.2Macro F1PFN
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| PFNPre-trained embedding=BERT, Match setting=exact match2021.08 | 83.2 | — | — | — | |
| Table-SequencePre-trained embedding=ALBERT, Match setting=exact match2021.08 | 80.1 | — | — | — | |
| PFNMatch setting=exact match2021.08 | 80 | — | — | — | |
| SpERTPre-trained embedding=BERT, Match setting=exact match2021.08 | 79.2 | — | — | — | |
| Rel-MetricMatch setting=exact match2021.08 | 77.3 | — | — | — | |
| Multi-head + ATMatch setting=exact match2021.08 | 75.5 | — | — | — | |
| Multi-headMatch setting=exact match2021.08 | 74.6 | — | — | — | |
| MultiheadReference=Bekoulis et al. 2018b2019.05 | — | 72.1 | 77.24 | 74.58 | |
| Multihead with ATReference=Bekoulis et al. 2018a2019.05 | — | — | — | 75.52 | |
| Multihead with AT (Replicated)Avg. Epoch Train Time=1567 sec, Avg. Test Time=40 sec, Protocol=Replicated under same hardware and 10-fold splits2019.05 | — | 74.43 | 78.45 | 76.36 | |
| Neural Joint ModelReference=Li et al. 20162019.05 | — | 64 | 62.9 | 63.4 | |
| Neural Joint ModelReference=Li et al. 20172019.05 | — | 67.5 | 75.8 | 71.4 | |
| Relation-Metric NetworkAvg. Epoch Train Time=134 sec, Avg. Test Time=4.5 sec2019.05 | — | 77.36 | 77.25 | 77.29 |