List your company
ResearchFormerly WizWand

Natural Language Inference on MNLI-m (dev)

90.6AccuracyDeBERTaV3_base
81.44883.82486.288.576Nov 18, 2021
Updated 8mo ago

Evaluation results

MethodLinks
DeBERTaV3_baseLayers=12, Hidden size=768, Heads=12, Vocabulary Size(K)=128, Backbone #Params(M)=862021.1190.6
ELECTRA_baseLayers=12, Hidden size=768, Heads=12, Vocabulary Size(K)=30, Backbone #Params(M)=862021.1188.8
DeBERTa_baseLayers=12, Hidden size=768, Heads=12, Vocabulary Size(K)=50, Backbone #Params(M)=1002021.1188.8
DeBERTaV3_smallLayers=6, Hidden size=768, Heads=12, Vocabulary Size(K)=128, Backbone #Params(M)=442021.1188.2
DeBERTaV3_xsmallLayers=12, Hidden size=384, Heads=6, Vocabulary Size(K)=128, Backbone #Params(M)=222021.1188.1
RoBERTa_baseLayers=12, Hidden size=768, Heads=12, Vocabulary Size(K)=50, Backbone #Params(M)=862021.1187.6
MiniLMv2_smallLayers=6, Hidden size=768, Heads=12, Vocabulary Size(K)=30, Backbone #Params(M)=442021.1187
MiniLMv2_xsmallLayers=12, Hidden size=384, Heads=6, Vocabulary Size(K)=30, Backbone #Params(M)=222021.1186.9
XLNet_baseLayers=12, Hidden size=768, Heads=12, Vocabulary Size(K)=32, Backbone #Params(M)=922021.1186.8
TinyBERT_smallLayers=6, Hidden size=768, Heads=12, Vocabulary Size(K)=30, Backbone #Params(M)=442021.1184.5
BERT_baseLayers=12, Hidden size=768, Heads=12, Vocabulary Size(K)=30, Backbone #Params(M)=862021.1184.3
BERT_smallLayers=6, Hidden size=768, Heads=12, Vocabulary Size(K)=30, Backbone #Params(M)=442021.1181.8