List your company
ResearchFormerly WizWand

Mathematical Reasoning on Minerva Math (4-shot %)

20.6Minerva Math 4-shot AccuracyLoRA FP16
11.86414.13216.418.668May 22, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LoRA FP16Rank=r64, BPW=16.0, Size (MB)=185.5, Time=–2026.0520.6
LoRA FP16Rank=r16, BPW=16.0, Size (MB)=46.4, Time=–2026.0517.56
QAT FullRank=r16, BPW=4.0, Size (MB)=11.6, Time=+7h2026.0517.44
QAT FreezeRank=r16, BPW=4.0, Size (MB)=11.6, Time=+4h2026.0517.1
PTQ-LoRDBARank=r16, BPW=4.0, Size (MB)=11.6, Time=+2 min2026.0516.5
QAT FreezeRank=r64, BPW=1.0, Size (MB)=11.6, Time=+4h2026.0516.46
QAT FullRank=r64, BPW=1.0, Size (MB)=11.6, Time=+7h2026.0516.32
QAT FullRank=r16, BPW=2.0, Size (MB)=5.8, Time=+7h2026.0515.34
LoRAQuant ρ=0.9Rank=r16, BPW=1.71, Size (MB)=5.0, Time=+17 min2026.0515.2
QAT FreezeRank=r16, BPW=2.0, Size (MB)=5.8, Time=+4h2026.0515.2
LoRAQuant ρ=0.7Rank=r16, BPW=1.42, Size (MB)=4.1, Time=+11 min2026.0514.64
PTQ-LoRDBARank=r64, BPW=1.0, Size (MB)=11.6, Time=+2 min2026.0514.6
QAT ScratchRank=r16, BPW=4.0, Size (MB)=11.6, Time=7h2026.0514.14
LoRAQuant ρ=0.5Rank=r16, BPW=1.22, Size (MB)=3.6, Time=+8 min2026.0514.1
QAT FullRank=r16, BPW=1.5, Size (MB)=4.4, Time=+7h2026.0513.86
QAT FreezeRank=r16, BPW=1.5, Size (MB)=4.4, Time=+4h2026.0513.38
BitDelta-rowRank=r16, BPW=2.00, Size (MB)=5.8, Time=+0 min2026.0513.18
QAT ScratchRank=r64, BPW=1.0, Size (MB)=11.6, Time=7h2026.0513.04
BitDelta-scalarRank=r16, BPW=1.00, Size (MB)=2.9, Time=+0 min2026.0513
PTQ-LoRDBARank=r16, BPW=2.0, Size (MB)=5.8, Time=+2 min2026.0512.86
QAT ScratchRank=r16, BPW=2.0, Size (MB)=5.8, Time=7h2026.0512.76
BitDelta-col+distillRank=r16, BPW=1.00, Size (MB)=2.9, Time=+15 min2026.0512.68
BitDelta-columnRank=r16, BPW=1.00, Size (MB)=2.9, Time=+0 min2026.0512.66
QAT ScratchRank=r16, BPW=1.5, Size (MB)=4.4, Time=7h2026.0512.42
PTQ-LoRDBARank=r16, BPW=1.5, Size (MB)=4.4, Time=+2 min2026.0512.2