Bit-Flip Search on MMLU 1/10th Subset (test)
4End-to-End Runtime (hours)FlipLLM
Evaluation results
| Method | Links | |
|---|---|---|
| FlipLLMTarget Model=GPT-2 L, Parameters=774M2025.12 | 4 | |
| GenBFATarget Model=GPT-2 L, Parameters=774M2025.12 | 10 | |
| FlipLLMTarget Model=LLaMA 3.1, Parameters=8B2025.12 | 18 | |
| FlipLLMTarget Model=DeepSeek-V2, Parameters=7B MoE2025.12 | 26 | |
| GenBFATarget Model=DeepSeek-V2, Parameters=7B MoE2025.12 | 42 | |
| GenBFATarget Model=LLaMA 3.1, Parameters=8B2025.12 | 43 |