List your company
ResearchFormerly WizWand

Scientific Natural Language Inference on SciNLI 1.0 (test)

79.62Macro F1WCT-CV
60.473665.444370.41575.3857Jun 20, 2024
Updated 8mo ago

Evaluation results

MethodLinks
WCT-CVBackbone=RoBERTa2024.0679.6279.65
WCT-CCBackbone=RoBERTa2024.0679.1279.15
CO-TEACHINGBackbone=RoBERTa2024.0678.7278.77
WCT-CVBackbone=SciBERT2024.0678.5578.57
WCT-CCBackbone=SciBERT2024.0678.3578.36
DS-LABELED (101K)Backbone=RoBERTa2024.0678.0878.11
CO-TEACHINGBackbone=SciBERT2024.0678.0678.05
DS-LABELED (101K)Backbone=SciBERT2024.0677.5377.52
CO-TEACHING+Backbone=RoBERTa2024.0676.4776.45
CO-TEACHING+Backbone=SciBERT2024.0676.2776.24
DBSTBackbone=RoBERTa2024.0673.7473.72
DBSTBackbone=SciBERT2024.0673.6173.59
SOFTMATCHBackbone=RoBERTa2024.0671.871.85
FLEXMATCHBackbone=RoBERTa2024.0671.6471.65
FIXMATCHBackbone=RoBERTa2024.0671.2771.32
CO-TRAININGBackbone=RoBERTa2024.0670.3570.47
BT (H-LABELED 2K)Backbone=RoBERTa2024.0670.2370.29
FS (H-LABELED 2K)Backbone=RoBERTa2024.0670.1370.14
SOFTMATCHBackbone=SciBERT2024.0668.7768.7
FLEXMATCHBackbone=SciBERT2024.0668.668.56
CO-TRAININGBackbone=SciBERT2024.0668.2968.28
FIXMATCHBackbone=SciBERT2024.0668.2168.21
BT (H-LABELED 2K)Backbone=SciBERT2024.0668.1268.18
BT (H-LABELED 1K)Backbone=RoBERTa2024.0667.7367.78
FS (H-LABELED 1K)Backbone=RoBERTa2024.0667.767.78
FS (H-LABELED 2K)Backbone=SciBERT2024.0667.4667.51
DS-LABELED (2K)Backbone=RoBERTa2024.0667.0167.02
FS (H-LABELED 1K)Backbone=SciBERT2024.0665.3165.39
DS-LABELED (2K)Backbone=SciBERT2024.0664.7464.75
BT (H-LABELED 1K)Backbone=SciBERT2024.0664.1364.17
DS-LABELED (1K)Backbone=RoBERTa2024.0663.2963.45
DS-LABELED (1K)Backbone=SciBERT2024.0661.2161.35