List your company

Commonsense Reasoning on StrategyQA (accuracy)

69.5Accuracy (StrategyQA)Dense
4.39621.29838.255.102Apr 27, 2026

Evaluation results

MethodLinks
DenseBackbone Model=Llama-3-8B-Instruct, Sparsity=0%2026.0469.5
CAPBackbone Model=Llama-3-8B-Instruct, Sparsity=10%2026.0465.5
CAPBackbone Model=Mistral-7B-Instruct, Sparsity=10%2026.0465.3
WandaBackbone Model=Mistral-7B-Instruct, Sparsity=10%2026.0465.1
WandaBackbone Model=Llama-3-8B-Instruct, Sparsity=10%2026.0465
CAPBackbone Model=Mistral-7B-Instruct, Sparsity=20%2026.0464.8
DenseBackbone Model=Mistral-7B-Instruct, Sparsity=0%2026.0464.3
WandaBackbone Model=Mistral-7B-Instruct, Sparsity=20%2026.0463.8
CAPBackbone Model=Llama-3-8B-Instruct, Sparsity=20%2026.0463.1
WandaBackbone Model=Llama-3-8B-Instruct, Sparsity=20%2026.0460.5
CAPBackbone Model=Mistral-7B-Instruct, Sparsity=50%2026.0453
WandaBackbone Model=Llama-3-8B-Instruct, Sparsity=50%2026.0451.7
WandaBackbone Model=Mistral-7B-Instruct, Sparsity=50%2026.0449.5
CAPBackbone Model=Llama-3-8B-Instruct, Sparsity=50%2026.046.9