List your company

Relation Extraction on ADE (test)

90Macro F1BioBERT
62.33669.51876.783.882Sep 2, 2021Sep 21, 2021Oct 10, 2021Oct 29, 2021Nov 17, 2021Dec 6, 2021Dec 25, 2021

Evaluation results

MethodLinks
BioBERTArchitecture=Accuracy-Optimized BioBERT2021.1290————
FCNNArchitecture=Speed-Optimized FCNN2021.1289.2————
Oursvalidation=10-fold cross-validation, classifier=KNN classifier, model=CLDR2021.0986.5————
Crone 20202021.1283.7————
Zhao et al., 2020validation=10-fold cross-validation2021.0981.14————
Wang and Lu, 2020validation=10-fold cross-validation2021.0980.1————
Oursvalidation=10-fold cross-validation, model=CLDR2021.0979.97————
Eberts and Ulges, 2020validation=10-fold cross-validation2021.0979.24————
Tran and Kavuluru, 2019validation=10-fold cross-validation2021.0977.29————
Bekoulis et al., 2018avalidation=10-fold cross-validation2021.0975.52————
Bekoulis et al., 2018bvalidation=10-fold cross-validation2021.0974.58————
Li et al., 2017validation=10-fold cross-validation2021.0971.4————
Li et al., 2016validation=10-fold cross-validation2021.0963.4————
Bekoulis et al.Averaging=macro-averaged2020.10——74.6——
Bekoulis et al.Averaging=macro-averaged2020.10——75.5——
BioBERT Relation Extraction modelArchitecture=BioBERT2022.01—80.1—81.3179.03
Eberts and UlgesAveraging=macro-averaged2020.10——79.2——
FCNN Relation Extraction modelArchitecture=FCNN2022.01—74.7—69.1186.22
Li et al.Averaging=macro-averaged2020.10——63.4——
Li et al.Averaging=macro-averaged2020.10——71.4——
Multi-head + ATAveraging method=macro-average2021.01—75.52———
SOTA2022.01—83.74———
SpERTEvaluation protocol=strict, Averaging method=macro-average2021.01—78.84—77.7779.96
Table-Sequence EncodersAveraging=macro-averaged2020.10—80.180.1——
Tran and KavuluruAveraging=macro-averaged2020.10——77.3——
TriMFEvaluation protocol=boundary, Averaging method=macro-average2021.01—80.66—74.2288.48