# Image Classification on MNIST (test) (Accuracy, Loss, and Operational Metrics) Source: [Image Classification on MNIST (test) (Accuracy, Loss, and Operational Metrics)]() Collection index: [llms.txt]() Data updated: 2026-07-07T10:36:43.108Z Evaluation of Image Classification models on the MNIST test set, reporting standard performance metrics (Accuracy, Test Loss) alongside operational metrics such as Maximum Energy consumption, Projection Rate, and Activation Overflow. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image Classification | | Dataset (including any stated split) | MNIST (test) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Test Loss](): Lower is better; unit: SCALAR. - [Max Energy](): Lower is better; unit: OTHER. - [Projection Rate](): Higher is better; unit: PERCENT. - [Activation Overflow](): Lower is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | FP32 | 89.15 | Not recorded | 6a4c882085dba69fef8b2942 | | FP32 + Monotone | 86.95 | Not recorded | 6a4c882085dba69fef8b2942 | | QAT Wrap + Monotone | 86.55 | Not recorded | 6a4c882085dba69fef8b2942 | | QAT Wrap + Monotone | 85.8 | Not recorded | 6a4c882085dba69fef8b2942 | | PTQ Wrap + Monotone | 84.1 | Not recorded | 6a4c882085dba69fef8b2942 | | PTQ Wrap + Monotone | 84.02 | Not recorded | 6a4c882085dba69fef8b2942 | | QAT Wrap + Monotone | 82.4 | Not recorded | 6a4c882085dba69fef8b2942 | | PTQ Wrap + Monotone | 80.83 | Not recorded | 6a4c882085dba69fef8b2942 | | PTQ Wrap | 75.37 | Not recorded | 6a4c882085dba69fef8b2942 | | PTQ Wrap | 74.77 | Not recorded | 6a4c882085dba69fef8b2942 | | PTQ Wrap | 64.65 | Not recorded | 6a4c882085dba69fef8b2942 | | PTQ Wrap + Monotone | 12.5 | Not recorded | 6a4c882085dba69fef8b2942 | | QAT Wrap | 11.6 | Not recorded | 6a4c882085dba69fef8b2942 | | PTQ Wrap | 11.35 | Not recorded | 6a4c882085dba69fef8b2942 | | QAT Wrap | 10.88 | Not recorded | 6a4c882085dba69fef8b2942 | | QAT Wrap | 10.25 | Not recorded | 6a4c882085dba69fef8b2942 | | QAT Wrap + Monotone | 10.25 | Not recorded | 6a4c882085dba69fef8b2942 | | QAT Wrap | 9.87 | Not recorded | 6a4c882085dba69fef8b2942 | ### FP32 Accuracy: 89.15. Result ID: 6a4cd6a760b88bb339cab93b. [Reporting paper]() Recorded evaluation configuration: {"Bits":"–"}. This record does not assert independent reproduction. ### FP32 + Monotone Accuracy: 86.95. Result ID: 6a4cd6a760b88bb339cab93c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"–"}. This record does not assert independent reproduction. ### QAT Wrap + Monotone Accuracy: 86.55. Result ID: 6a4cd6a760b88bb339cab94c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"12"}. This record does not assert independent reproduction. ### QAT Wrap + Monotone Accuracy: 85.8. Result ID: 6a4cd6a760b88bb339cab94b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"8"}. This record does not assert independent reproduction. ### PTQ Wrap + Monotone Accuracy: 84.1. Result ID: 6a4cd6a760b88bb339cab943. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"8"}. This record does not assert independent reproduction. ### PTQ Wrap + Monotone Accuracy: 84.02. Result ID: 6a4cd6a760b88bb339cab944. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"12"}. This record does not assert independent reproduction. ### QAT Wrap + Monotone Accuracy: 82.4. Result ID: 6a4cd6a760b88bb339cab94a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"6"}. This record does not assert independent reproduction. ### PTQ Wrap + Monotone Accuracy: 80.83. Result ID: 6a4cd6a760b88bb339cab942. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"6"}. This record does not assert independent reproduction. ### PTQ Wrap Accuracy: 75.37. Result ID: 6a4cd6a760b88bb339cab940. [Reporting paper]() Recorded evaluation configuration: {"Bits":"12"}. This record does not assert independent reproduction. ### PTQ Wrap Accuracy: 74.77. Result ID: 6a4cd6a760b88bb339cab93f. [Reporting paper]() Recorded evaluation configuration: {"Bits":"8"}. This record does not assert independent reproduction. ### PTQ Wrap Accuracy: 64.65. Result ID: 6a4cd6a760b88bb339cab93e. [Reporting paper]() Recorded evaluation configuration: {"Bits":"6"}. This record does not assert independent reproduction. ### PTQ Wrap + Monotone Accuracy: 12.5. Result ID: 6a4cd6a760b88bb339cab941. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"4"}. This record does not assert independent reproduction. ### QAT Wrap Accuracy: 11.6. Result ID: 6a4cd6a760b88bb339cab946. [Reporting paper]() Recorded evaluation configuration: {"Bits":"6"}. This record does not assert independent reproduction. ### PTQ Wrap Accuracy: 11.35. Result ID: 6a4cd6a760b88bb339cab93d. [Reporting paper]() Recorded evaluation configuration: {"Bits":"4"}. This record does not assert independent reproduction. ### QAT Wrap Accuracy: 10.88. Result ID: 6a4cd6a760b88bb339cab947. [Reporting paper]() Recorded evaluation configuration: {"Bits":"8"}. This record does not assert independent reproduction. ### QAT Wrap Accuracy: 10.25. Result ID: 6a4cd6a760b88bb339cab945. [Reporting paper]() Recorded evaluation configuration: {"Bits":"4"}. This record does not assert independent reproduction. ### QAT Wrap + Monotone Accuracy: 10.25. Result ID: 6a4cd6a760b88bb339cab949. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Bits":"4"}. This record does not assert independent reproduction. ### QAT Wrap Accuracy: 9.87. Result ID: 6a4cd6a760b88bb339cab948. [Reporting paper]() Recorded evaluation configuration: {"Bits":"12"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.