List your company

Multitask Language Understanding on MMLU (Drift and Speedup)

0.1Drift (pp)Qwen3-8B
0.04480.41740.791.1626Jun 22, 2026

Evaluation results

MethodLinks
Qwen3-8BQuantization=INT4, Hardware=NPU, Framework=MINCE2026.060.11.7
Phi-4-mini-InstQuantization=INT4, Hardware=NPU, Framework=MINCE2026.060.722
Llama-3.1-8B-InstQuantization=INT4, Hardware=NPU, Framework=MINCE2026.061.483.4