Relation Extraction on ChemProt (micro F1)
84.62Micro F1RoBERTa-large
Evaluation Results
| Method | Links | |
|---|---|---|
| RoBERTa-largeParam=355M, Data=160G, FLOPS=4.36E212023.05 | 84.62 | |
| Bert LargeParam=355M, Data=16G, FLOPS=9.07E192023.05 | 83.64 | |
| TLM(Large)Param=109M, Data=3.64G, FLOPS=2.33E192023.05 | 83.6 | |
| ISS(Medium-scale)Param=109M, Data=0.18G, FLOPS=4.15E182023.05 | 83.42 | |
| ISS(Large-scale)Param=109M, Data=0.72G, FLOPS=8.30E182023.05 | 83.31 | |
| TLM(Medium)Param=109M, Data=1.21G, FLOPS=8.30E182023.05 | 83.24 | |
| TLM(Large-20%)Param=109M, Data=0.72G, FLOPS=8.30E182023.05 | 82.63 | |
| RoBERTa-BaseParam=125M, Data=160G, FLOPS=1.54E212023.05 | 82.6 | |
| TLM(Small)Param=109M, Data=0.91G, FLOPS=2.74E182023.05 | 81.99 | |
| Bert-BaseParam=109M, Data=16G, FLOPS=2.79E192023.05 | 81.94 | |
| ISS(Small-scale)Param=109M, Data=0.18G, FLOPS=1.82E182023.05 | 81.71 | |
| TLM(Medium-20%)Param=109M, Data=0.18G, FLOPS=4.15E182023.05 | 81.05 | |
| TLM(Small-20%)Param=109M, Data=0.18G, FLOPS=1.82E182023.05 | 80.8 | |
| CPSupervised training data percentage=100%, Input configuration=C+M2020.10 | 80.6 | |
| CPSupervised training data percentage=100%, Input configuration=OnlyC2020.10 | 80.3 | |
| MTBSupervised training data percentage=100%, Input configuration=OnlyC2020.10 | 79.8 | |
| MTBSupervised training data percentage=100%, Input configuration=C+M2020.10 | 79.6 | |
| BERTSupervised training data percentage=100%, Input configuration=C+M2020.10 | 79.2 | |
| BERTSupervised training data percentage=100%, Input configuration=OnlyC2020.10 | 77.7 | |
| CPSupervised training data percentage=10%, Input configuration=C+M2020.10 | 70.8 | |
| CPSupervised training data percentage=10%, Input configuration=OnlyC2020.10 | 69.7 | |
| MTBSupervised training data percentage=10%, Input configuration=OnlyC2020.10 | 68.5 | |
| MTBSupervised training data percentage=10%, Input configuration=C+M2020.10 | 68.3 | |
| BERTSupervised training data percentage=10%, Input configuration=C+M2020.10 | 63.4 | |
| BERTSupervised training data percentage=10%, Input configuration=OnlyC2020.10 | 58.4 | |
| CPSupervised training data percentage=100%, Input configuration=OnlyM2020.10 | 46.7 | |
| BERTSupervised training data percentage=100%, Input configuration=OnlyM2020.10 | 46.3 | |
| MTBSupervised training data percentage=100%, Input configuration=OnlyM2020.10 | 46.3 | |
| CPSupervised training data percentage=10%, Input configuration=OnlyM2020.10 | 40.4 | |
| MTBSupervised training data percentage=10%, Input configuration=OnlyM2020.10 | 40.3 | |
| BERTSupervised training data percentage=10%, Input configuration=OnlyM2020.10 | 38.5 | |
| BERTSupervised training data percentage=1%, Input configuration=C+M2020.10 | 36.2 | |
| BERTSupervised training data percentage=1%, Input configuration=OnlyC2020.10 | 36.2 | |
| BERTSupervised training data percentage=1%, Input configuration=OnlyM2020.10 | 36.2 | |
| MTBSupervised training data percentage=1%, Input configuration=C+M2020.10 | 36.2 | |
| MTBSupervised training data percentage=1%, Input configuration=OnlyC2020.10 | 36.2 | |
| MTBSupervised training data percentage=1%, Input configuration=OnlyM2020.10 | 36.2 | |
| CPSupervised training data percentage=1%, Input configuration=OnlyC2020.10 | 36.2 | |
| CPSupervised training data percentage=1%, Input configuration=C+M2020.10 | 36.1 | |
| CPSupervised training data percentage=1%, Input configuration=OnlyM2020.10 | 36 |