Question Answering on OpenBookQA (Accuracy %)
48.47AccuracyDeepSeek-R1 (BF16)
Evaluation results
| Method | Links | |
|---|---|---|
| DeepSeek-R1 (BF16)Model=DeepSeek-R1, Setting=W16A16, Sparsity=0, Evaluation Protocol=Non-generative2025.12 | 48.47 | |
| SQ-formatModel=DeepSeek-R1, Setting=W(SQ5)A8, Sparsity=0.875, Evaluation Protocol=Non-generative2025.12 | 46.67 |