ResearchBenchmarksLanguage Understanding on MMLU-Pro (Accuracy and Bit Metrics)Language Understanding on MMLU-Pro (Accuracy and Bit Metrics)Follow48.2Baseline AccuracyFlipLLM25.94431.72237.543.278Dec 10, 2025Evaluation resultsMethodMethodLinksBaseline AccuracyFinal AccuracyCritical BitsFlipLLMType=LLM, Target Model...Type=LLM, Target Model=DeepSeek-V2, Parameters=7B (MoE)2025.1248.20.166FlipLLMType=LLM, Target Model...Type=LLM, Target Model=LLaMA 3.1 8B, Parameters=8B2025.1245.10.155FlipLLMType=LLM, Target Model...Type=LLM, Target Model=GPT-2 Large, Parameters=774M2025.1226.80.255