List your company
ResearchFormerly WizWand

Multiple Choice Classification on AGNews

84.5AccuracyUnifiedQA-3b
22.6238.68554.7570.815Jul 19, 2023
Updated 8mo ago

Evaluation results

MethodLinks
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.0784.5
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.0775.7
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.0771
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.0767.9
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.0746.6
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.0744.4
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.0739.1
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.0735.7
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.0730.2
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.0727.9
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.0726.9
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.0725.8
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.0725.2
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.0725.1
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.0725
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.0725