List your company
ResearchFormerly WizWand

Multimodal Understanding and QA on MME, OCRBench, DocVQA, RealWorldQA, and VLMBlind

2,386MME ScoreBATQuant
1,978.322,084.162,1902,295.84Mar 17, 2026
Updated 7mo ago

Evaluation results

MethodLinks
BATQuantBits=W4A8KV162026.032,38689395.5570.273.1499.29
BF16Bits=BF162026.032,37790695.8170.9873.98100
BATQuantBits=W4A8KV82026.032,36889095.4769.9372.8298.89
BATQuantBits=W4A4KV162026.032,36086494.3167.3269.796.43
FlatQuantBits=W4A8KV82026.032,35388895.1269.1472.7798.41
FlatQuantBits=W4A8KV162026.032,35188695.3169.0273.998.66
SmoothQuantBits=W4A8KV162026.032,34988594.8170.0669.4697.61
GPTQBits=W4A8KV162026.032,34689195.0369.1572.6298.36
GPTQBits=W4A8KV82026.032,34088595.1471.1171.7998.53
BATQuantBits=W4A8KV42026.032,33288595.0768.6370.9297.51
BRQBits=W4A8KV162026.032,32986594.7270.1967.1896.4
GPTQBits=W4A8KV42026.032,32886794.1568.170.8196.71
QuaRotBits=W4A8KV162026.032,32787095.0769.871.1297.53
SpinQuantBits=W4A8KV162026.032,32187294.7970.4669.8297.29
SmoothQuantBits=W4A8KV82026.032,31788494.7270.1968.9197.19
QuaRotBits=W4A8KV82026.032,29686895.1169.0270.2696.77
RTNBits=W4A8KV162026.032,29488394.7269.870.9997.43
FlatQuantBits=W4A8KV42026.032,29388494.8868.7670.7597.11
GPTQBits=W4A4KV162026.032,28684993.9866.9367.2994.64
BRQBits=W4A8KV82026.032,28386794.6369.867.3695.98
SmoothQuantBits=W4A8KV42026.032,28387194.3967.0266.9995.13
QuaRotBits=W4A8KV42026.032,28085794.6668.5268.3695.65
SmoothQuantBits=W4A4KV162026.032,26486293.9368.8966.2695.01
SpinQuantBits=W4A8KV42026.032,24882994.1868.6364.593.65
RTNBits=W4A4KV162026.032,24383892.765.2366.4793.07
BRQBits=W4A8KV42026.032,23684194.0768.6366.0394.2
FlatQuantBits=W4A4KV162026.032,23187394.165.6268.8694.79
RTNBits=W4A8KV42026.032,22085694.0568.567.594.76
SpinQuantBits=W4A8KV82026.032,21783294.4168.169.0494.58
RTNBits=W4A8KV82026.032,20887894.6469.5471.0196.51
QuaRotBits=W4A4KV162026.032,18981093.4764.9757.6289.69
BRQBits=W4A4KV162026.032,14780592.9466.1462.1490.74
SpinQuantBits=W4A4KV162026.031,99480191.7965.3660.2388.32