List your company
ResearchFormerly WizWand

Common Sense Reasoning on BoolQ

92.4AccuracyFine-tuning
72.411277.600682.7987.9794Mar 29, 2022Dec 7, 2022Aug 17, 2023Apr 26, 2024Jan 4, 2025Sep 14, 2025May 25, 2026
Updated 3mo ago

Evaluation results

MethodLinks
Fine-tuning2023.0692.4
Supervised SOTAsupervised=true2022.0391.4
VanillaBackbone=Qwen3-MoE-30B-A3B, Sparsity=0%2025.1188.7
PuzzleMoEBackbone=Qwen3-MoE-30B-A3B, Sparsity=25%2025.1188.2
PaLMParameters=540B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0288
WandaBackbone=Qwen3-MoE-30B-A3B, Sparsity=2:42025.1188
PuzzleMoEBackbone=Qwen3-MoE-30B-A3B, Sparsity=50%2025.1188
D2Backbone=Qwen3-MoE-30B-A3B, Sparsity=20%2025.1186.2
Sub-MoEBackbone=Mixtral-8x7B-v0.1, Sparsity=25%2025.1186
Sub-MoEBackbone=Qwen3-MoE-30B-A3B, Sparsity=25%2025.1186
VanillaBackbone=Mixtral-8x7B-v0.1, Sparsity=0%2025.1185.4
PuzzleMoEBackbone=Mixtral-8x7B-v0.1, Sparsity=25%2025.1185.4
LLaMAParameters=65B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0285.3
PuzzleMoEBackbone=Mixtral-8x7B-v0.1, Sparsity=50%2025.1185.3
FP16Model=Qwen2.5-14B2026.0385.23
HC-SMoEBackbone=Mixtral-8x7B-v0.1, Sparsity=25%2025.1184.9
PaLMParameters=62B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0284.8
FP16Backbone=Qwen2.5-7B2026.0384.65
RouterConnection Status=After connection, Collaboration Strategy=Routing-based2026.0584
DuetNetConnection Status=After connection, Collaboration Strategy=Token-level2026.0584
NAEEBackbone=Mixtral-8x7B-v0.1, Sparsity=25%2025.1184
Sub-MoEBackbone=Mixtral-8x7B-v0.1, Sparsity=50%2025.1184
Sub-MoEBackbone=Qwen3-MoE-30B-A3B, Sparsity=50%2025.1184
PaLM-contParameters=62B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0283.9
Chinchillazero-shot=true2022.0383.7
ChinchillaParameters=70B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0283.7
Vicuna-13B (v1.1)Zero-shot=true, Number of Parameters=13B, Version=v1.12023.0983.5
D2Backbone=Qwen3-MoE-30B-A3B, Sparsity=40%2025.1183.5
LLaMAParameters=33B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0283.1
STUNBackbone=Mixtral-8x7B-v0.1, Sparsity=25%2025.1183.1
ASCTotal AI agents=30, Cooperative agents=10, GPU=NVIDIA Tesla P1002026.0283
HC-SMoEBackbone=Qwen3-MoE-30B-A3B, Sparsity=25%2025.1182.4
FP16Model=Hymba-Instruct-1.5B, Compression Ratio=1x2026.0182.14
FP16Backbone=Llama-3.1-8B2026.0382.11
QMCModel=Hymba-Instruct-1.5B, Memory=2bits-MLC, Compression Ratio=4.44x2026.0182.07
LAWTotal AI agents=30, Cooperative agents=10, GPU=NVIDIA Tesla P1002026.0282
Qwen 2.5Connection Status=Before connection2026.0582
ClusCompBackbone=Llama-3-8B, #Bit=4.13, Zero-shot=true2025.0381.1
NAEEBackbone=Mixtral-8x7B-v0.1, Sparsity=50%2025.1181
LLAMA-3-8BModel=LLAMA-3-8B, Bits=FP16, Zero-shot=true2026.0480.95
HC-SMoEBackbone=Mixtral-8x7B-v0.1, Sparsity=50%2025.1180.8
HC-SMoEBackbone=Qwen3-MoE-30B-A3B, Sparsity=50%2025.1180.8
QMCModel=Hymba-Instruct-1.5B, Memory=3bits-MLC, Compression Ratio=4.44x2026.0180.61
FP16Model=Llama-2-13B2026.0380.55
ExGRPOStudent Model=Qwen2.5-7B-Instruct2026.0280.3
GATotal AI agents=30, Cooperative agents=10, GPU=NVIDIA Tesla P1002026.0280
VanillaBackbone=Qwen1.5-MoE-A2.7B, Sparsity=0%2025.1179.5
Gopherzero-shot=true2022.0379.3
GopherParameters=280B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0279.3
WandaBackbone=Mixtral-8x7B-v0.1, Sparsity=2:42025.1179.2
PuzzleMoEBackbone=Qwen1.5-MoE-A2.7B, Sparsity=25%2025.1179.2
ClusCompBackbone=Llama-3-8B, #Bit=2.87, Zero-shot=true2025.0379
NSDSModel=Qwen2.5-14B2026.0378.62
PuzzleMoEBackbone=Qwen1.5-MoE-A2.7B, Sparsity=50%2025.1178.6
MT-NLG 530Bzero-shot=true2022.0378.2
FP16Model=Qwen2.5-1.5B-Instruct, Compression Ratio=1x2026.0178.2
KurtosisModel=Qwen2.5-14B2026.0378.13
LLaMAParameters=13B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0278.1
ZDModel=Qwen2.5-14B2026.0377.97
Llama2-7BZero-shot=true, Number of Parameters=7B2023.0977.9
RevThinkStudent Model=Qwen2.5-7B-Instruct2026.0277.1
MSEModel=Qwen2.5-14B2026.0376.94
NSDSModel=Llama-2-13B2026.0376.75
MXINT4Model=Hymba-Instruct-1.5B, Compression Ratio=4x2026.0176.73
LLaMAParameters=7B, Zero-shot=true, Likelihood Normalization=Answer-conditional2023.0276.5
MultiLoRAparams/task=10M, Backbone=Llama2-7B2026.0376.5
WandaBackbone=Qwen1.5-MoE-A2.7B, Sparsity=2:42025.1176.2
EPTparams/task=3.3M, Backbone=Llama2-7B2026.0376.1
KurtBoostModel=Llama-2-13B2026.0375.91
WandaBackbone=Deepseek-MoE-16b, Sparsity=2:42025.1175.9
phi-1.5 (1.3B)Zero-shot=true, Number of Parameters=1.3B2023.0975.8
EWQModel=Qwen2.5-14B2026.0375.69
AnsAugStudent Model=Qwen2.5-7B-Instruct2026.0275.53
RefLoRA-SBackbone=LLaMA3-8B, r=32, Params=0.70%2025.0575.5
RefLoRABackbone=LLaMA3-8B, r=32, Params=0.70%2025.0575.35
RefLoRABackbone=LLaMA3-8B, r=16, Params=0.35%2025.0575.26
EWQModel=Llama-2-13B2026.0375.22
D2Backbone=Qwen1.5-MoE-A2.7B, Sparsity=20%2025.1175.1
RandASTotal AI agents=30, Cooperative agents=10, GPU=NVIDIA Tesla P1002026.0275
RefLoRA-SBackbone=LLaMA3-8B, r=16, Params=0.35%2025.0574.92
PASERPruning Scheme=SparseGPT, Sparsity=50%2025.0274.79
ClusCompBackbone=Llama-3-8B, #Bit=2.27, Zero-shot=true2025.0374.7
MoREparams/task=4.5M, Backbone=Llama2-7B2026.0374.7
SKDStudent Model=Qwen2.5-7B-Instruct2026.0274.62
DoRABackbone=LLaMA3-8B, r=32, Params=0.71%2025.0574.6
FP16Model=Phi-1.5B, Compression Ratio=1x2026.0174.56
DoRABackbone=LLaMA3-8B, r=16, Params=0.35%2025.0574.5
PuzzleMoEBackbone=Deepseek-MoE-16b, Sparsity=50%2025.1174.5
HC-SMoEBackbone=Qwen1.5-MoE-A2.7B, Sparsity=25%2025.1174.2
LoRA-RITEBackbone=LLaMA3-8B, r=32, Params=0.84%2025.0574.19
BoHAModel=Llama-3.2-3B, #Params=48.63M2025.0974.19
ZDModel=Llama-2-13B2026.0374.01
LoRAparams/task=2.1M, Backbone=Llama2-7B2026.0374
MPT-7BZero-shot=true, Number of Parameters=7B2023.0973.9
RTNModel=Phi-1.5B, Format=INT4, Compression Ratio=4x2026.0173.79
FFTModel=Llama-3.2-3B, #Params=3.21B2025.0973.58
RefLoRA-SBackbone=LLaMA2-7B, r=32, Params=0.83%2025.0573.36
MOELoRAparams/task=4.5M, Backbone=Llama2-7B2026.0373.3
Llama-7BZero-shot=true, Number of Parameters=7B2023.0973.2
NSDSBackbone=Qwen2.5-7B2026.0373.18