List your company
ResearchFormerly WizWand

General Reasoning on BigBench-Lite Topic Domains

66.8BBL ScoreQwen-3B (KOFF)
-2.2934415.6442833.58251.51972May 27, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Qwen-3B (KOFF)Model Backbone=Qwen-3B, Model Variant=KOFF, Global Sparsity Level=12%2026.0566.8
Llama-8B (KOFF)Model Backbone=Llama-8B, Model Variant=KOFF, Global Sparsity Level=12%2026.0548
Llama-3B (KOFF)Model Backbone=Llama-3B, Model Variant=KOFF, Global Sparsity Level=12%2026.0547
Llama-8B (unpruned)Model Backbone=Llama-8B, Model Variant=unpruned, Global Sparsity Level=0%2026.0543.5
Qwen-3B (unpruned)Model Backbone=Qwen-3B, Model Variant=unpruned, Global Sparsity Level=0%2026.0541
Llama-3B (unpruned)Model Backbone=Llama-3B, Model Variant=unpruned, Global Sparsity Level=0%2026.0539.3
Llama-3B (pruning only)Model Backbone=Llama-3B, Model Variant=pruning only, Global Sparsity Level=12%2026.0537.2
Qwen-3B (pruning only)Model Backbone=Qwen-3B, Model Variant=pruning only, Global Sparsity Level=12%2026.0536
Llama-8B (pruning only)Model Backbone=Llama-8B, Model Variant=pruning only, Global Sparsity Level=12%2026.0535.3
Llama-8B (unpruned)Model Backbone=Llama-8B, Model Variant=unpruned, Global Sparsity Level=0%2026.050.492
Llama-3B (KOFF)Model Backbone=Llama-3B, Model Variant=KOFF, Global Sparsity Level=12%2026.050.412
Qwen-3B (unpruned)Model Backbone=Qwen-3B, Model Variant=unpruned, Global Sparsity Level=0%2026.050.41
Llama-3B (unpruned)Model Backbone=Llama-3B, Model Variant=unpruned, Global Sparsity Level=0%2026.050.393
Llama-8B (KOFF)Model Backbone=Llama-8B, Model Variant=KOFF, Global Sparsity Level=12%2026.050.386
Llama-3B (pruning only)Model Backbone=Llama-3B, Model Variant=pruning only, Global Sparsity Level=12%2026.050.382
Qwen-3B (KOFF)Model Backbone=Qwen-3B, Model Variant=KOFF, Global Sparsity Level=12%2026.050.38
Qwen-3B (pruning only)Model Backbone=Qwen-3B, Model Variant=pruning only, Global Sparsity Level=12%2026.050.374
Llama-8B (pruning only)Model Backbone=Llama-8B, Model Variant=pruning only, Global Sparsity Level=12%2026.050.364