List your company
ResearchFormerly WizWand

Relation Extraction on ChemProt (micro F1)

84.62Micro F1RoBERTa-large
34.055247.182660.3173.4374Oct 5, 2020Mar 13, 2021Aug 20, 2021Jan 27, 2022Jul 6, 2022Dec 13, 2022May 22, 2023
Updated 8mo ago

Evaluation results

MethodLinks
RoBERTa-largeParam=355M, Data=160G, FLOPS=4.36E212023.0584.62
Bert LargeParam=355M, Data=16G, FLOPS=9.07E192023.0583.64
TLM(Large)Param=109M, Data=3.64G, FLOPS=2.33E192023.0583.6
ISS(Medium-scale)Param=109M, Data=0.18G, FLOPS=4.15E182023.0583.42
ISS(Large-scale)Param=109M, Data=0.72G, FLOPS=8.30E182023.0583.31
TLM(Medium)Param=109M, Data=1.21G, FLOPS=8.30E182023.0583.24
TLM(Large-20%)Param=109M, Data=0.72G, FLOPS=8.30E182023.0582.63
RoBERTa-BaseParam=125M, Data=160G, FLOPS=1.54E212023.0582.6
TLM(Small)Param=109M, Data=0.91G, FLOPS=2.74E182023.0581.99
Bert-BaseParam=109M, Data=16G, FLOPS=2.79E192023.0581.94
ISS(Small-scale)Param=109M, Data=0.18G, FLOPS=1.82E182023.0581.71
TLM(Medium-20%)Param=109M, Data=0.18G, FLOPS=4.15E182023.0581.05
TLM(Small-20%)Param=109M, Data=0.18G, FLOPS=1.82E182023.0580.8
CPSupervised training data percentage=100%, Input configuration=C+M2020.1080.6
CPSupervised training data percentage=100%, Input configuration=OnlyC2020.1080.3
MTBSupervised training data percentage=100%, Input configuration=OnlyC2020.1079.8
MTBSupervised training data percentage=100%, Input configuration=C+M2020.1079.6
BERTSupervised training data percentage=100%, Input configuration=C+M2020.1079.2
BERTSupervised training data percentage=100%, Input configuration=OnlyC2020.1077.7
CPSupervised training data percentage=10%, Input configuration=C+M2020.1070.8
CPSupervised training data percentage=10%, Input configuration=OnlyC2020.1069.7
MTBSupervised training data percentage=10%, Input configuration=OnlyC2020.1068.5
MTBSupervised training data percentage=10%, Input configuration=C+M2020.1068.3
BERTSupervised training data percentage=10%, Input configuration=C+M2020.1063.4
BERTSupervised training data percentage=10%, Input configuration=OnlyC2020.1058.4
CPSupervised training data percentage=100%, Input configuration=OnlyM2020.1046.7
BERTSupervised training data percentage=100%, Input configuration=OnlyM2020.1046.3
MTBSupervised training data percentage=100%, Input configuration=OnlyM2020.1046.3
CPSupervised training data percentage=10%, Input configuration=OnlyM2020.1040.4
MTBSupervised training data percentage=10%, Input configuration=OnlyM2020.1040.3
BERTSupervised training data percentage=10%, Input configuration=OnlyM2020.1038.5
BERTSupervised training data percentage=1%, Input configuration=C+M2020.1036.2
BERTSupervised training data percentage=1%, Input configuration=OnlyC2020.1036.2
BERTSupervised training data percentage=1%, Input configuration=OnlyM2020.1036.2
MTBSupervised training data percentage=1%, Input configuration=C+M2020.1036.2
MTBSupervised training data percentage=1%, Input configuration=OnlyC2020.1036.2
MTBSupervised training data percentage=1%, Input configuration=OnlyM2020.1036.2
CPSupervised training data percentage=1%, Input configuration=OnlyC2020.1036.2
CPSupervised training data percentage=1%, Input configuration=C+M2020.1036.1
CPSupervised training data percentage=1%, Input configuration=OnlyM2020.1036