List your company
ResearchFormerly WizWand

Quantization Detection on BigCodeBench

0.041RUTMistral
0.018920.167960.3170.46604Jun 8, 2025
Updated 7mo ago

Evaluation results

MethodLinks
MistralQuantization=8-bit2025.060.0410.0580.011
GemmaQuantization=8-bit2025.060.0480.0520
LlamaQuantization=8-bit2025.060.0930.1430.021
GemmaQuantization=4-bit2025.060.1360.170
MistralQuantization=4-bit2025.060.4620.3260.183
LlamaQuantization=4-bit2025.060.5930.3530.524