List your company
ResearchFormerly WizWand

Language Modeling on Language Domains Multilingual

9.03Average PPLLlama-8B (KOFF)
8.775210.495112.21513.9349May 27, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Llama-8B (KOFF)Model Backbone=Llama-8B, Model Variant=KOFF, Global Sparsity Level=12%2026.059.03
Llama-8B (pruning only)Model Backbone=Llama-8B, Model Variant=pruning only, Global Sparsity Level=12%2026.059.54
Llama-8B (unpruned)Model Backbone=Llama-8B, Model Variant=unpruned, Global Sparsity Level=0%2026.059.62
Qwen-3B (KOFF)Model Backbone=Qwen-3B, Model Variant=KOFF, Global Sparsity Level=12%2026.0510.38
Qwen-3B (pruning only)Model Backbone=Qwen-3B, Model Variant=pruning only, Global Sparsity Level=12%2026.0512.1
Qwen-3B (unpruned)Model Backbone=Qwen-3B, Model Variant=unpruned, Global Sparsity Level=0%2026.0513.42
Llama-3B (KOFF)Model Backbone=Llama-3B, Model Variant=KOFF, Global Sparsity Level=12%2026.0514.95
Llama-3B (pruning only)Model Backbone=Llama-3B, Model Variant=pruning only, Global Sparsity Level=12%2026.0515.12
Llama-3B (unpruned)Model Backbone=Llama-3B, Model Variant=unpruned, Global Sparsity Level=0%2026.0515.4