List your company
ResearchFormerly WizWand

Commonsense Reasoning on CommonsenseQA (CSQA) v1.0 (test)

64.11AccuracyCKT-base
18.235630.145342.05553.9647Jun 4, 2023Sep 15, 2023Dec 28, 2023Apr 10, 2024Jul 23, 2024Nov 4, 2024Feb 16, 2025
Updated 8mo ago

Evaluation results

MethodLinks
CKT-baseBackbone=T5-base, Method=CKT2023.0664.11
CALMBackbone=T5-base2023.0663.32
T5-base + CSKG (Rule)Backbone=T5-base, Augmentation=CSKG (Rule)2023.0663.1
T5-base + SSMBackbone=T5-base, Augmentation=SSM2023.0662.37
T5-base + TIBackbone=T5-base, Augmentation=TI2023.0662.05
T5-baseBackbone=T5-base, Model Size=Base2023.0661.88
T5-base + KDBackbone=T5-base, Augmentation=KD2023.0661.83
CKT w/ GPT-2Backbone=GPT-2, Method=CKT2023.0660.39
T5-base + CSKG (TI)Backbone=T5-base, Augmentation=CSKG (TI)2023.0660.22
ERNIE-baseBackbone=ERNIE-base, Model Size=Base2023.0654.06
KnowBERTBackbone=KnowBERT, Model Size=Base2023.0653.88
BERT-baseBackbone=BERT-base, Model Size=Base2023.0653.08
COMETBackbone=BART, Model Size=Base2023.0645.32
TituLLM-3b-v2.0Shots=52025.0233
BLOOM-3bShots=52025.0232
BLOOM-1b7Shots=52025.0230
Llama-3.2-3bShots=52025.0229
Gemma-2-2bShots=52025.0228
TituLLM-1b-v2.0Shots=52025.0228
TituLLM-3b-v2.0Shots=02025.0228
BLOOM-1b1Shots=02025.0227
BLOOM-1b1Shots=52025.0227
BLOOM-1b7Shots=02025.0227
BLOOM-3bShots=02025.0227
Llama-3.2-3bShots=02025.0226
Gemma-2-2bShots=02025.0226
BLOOM-560mShots=02025.0226
BLOOM-560mShots=52025.0226
TituLLM-1b-v2.0Shots=02025.0226
BongLLaMA-3.2-1bShots=52025.0224
Llama-3.2-1bShots=02025.0223
Llama-3.2-1bShots=52025.0223
Qwen-2.5-1.5bShots=02025.0223
Qwen-2.5-1.5bShots=52025.0223
davinciShots=02025.0222
Qwen-2.5-0.5bShots=52025.0222
SmolLM2-135mShots=02025.0222
SmolLM2-1.7bShots=02025.0222
BongLLaMA-3.2-1bShots=02025.0222
Qwen-2.5-0.5bShots=02025.0221
SmolLM2-135mShots=52025.0221
SmolLM2-360mShots=52025.0221
SmolLM2-1.7bShots=52025.0221
BongLLaMA-3.2-3bShots=02025.0221
SmolLM2-360mShots=02025.0220
BongLLaMA-3.2-3bShots=52025.0220