List your company
ResearchFormerly WizWand

Multiple Choice Classification on e-SNLI

89.6AccuracyUnifiedQA-3b
34.89649.09863.377.502Jul 19, 2023
Updated 8mo ago

Evaluation results

MethodLinks
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.0789.6
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.0774.2
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.0770.2
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.0765.7
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.0765.7
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.0765.7
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.0765.7
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.0765.2
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.0765.1
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.0762.2
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.0761.5
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.0757.6
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.0742.8
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.0740.8
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.0738.5
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.0737