List your company
ResearchFormerly WizWand

Visual Reasoning on NLVR2 (dev)

82.5AccuracyMADTP
56.156862.995969.83576.6741Mar 5, 2024Jul 12, 2024Nov 18, 2024Mar 28, 2025Aug 4, 2025Dec 11, 2025Apr 20, 2026
Updated 6mo ago

Evaluation results

MethodLinks
MADTPReduce Ratio=0.3, GFLOPS=92.60, Backbone=BLIP2024.0382.5
UncompressedReduce Ratio=/, GFLOPS=132.54, Backbone=BLIP2024.0382.48
MADTPReduce Ratio=0.5, GFLOPS=66.16, Backbone=BLIP2024.0381.97
MADTPReduce Ratio=0.6, GFLOPS=52.92, Backbone=BLIP2024.0381.92
MADTPReduce Ratio=0.7, GFLOPS=39.69, Backbone=BLIP2024.0380.67
UPopReduce Ratio=0.3, GFLOPS=89.36, Backbone=BLIP2024.0380.33
STPReduce Ratio=0.3, GFLOPS=94.08, Backbone=BLIP2024.0379.5
CoMPGFLOPs=26.33±0.382026.0479.13
MADTPReduce Ratio=0.8, GFLOPS=26.46, Backbone=BLIP2024.0378.28
STPReduce Ratio=0.5, GFLOPS=68.31, Backbone=BLIP2024.0378.08
MADTPGFLOPs=26.77±0.232026.0477.16
MH-MoEExperts Number=82024.0477
UPopReduce Ratio=0.5, GFLOPS=65.29, Backbone=BLIP2024.0376.89
X-MoEExperts Number=82024.0475.5
Dense2024.0473.8
MiniVLMParams=52M, Training=100 Epochs2026.0473.7
UPopReduce Ratio=0.6, GFLOPS=50.35, Backbone=BLIP2024.0372.85
PixelBERTParams=110M, Training=40 Epochs2026.0471.7
EfficientParams=39.2M, Training=20 Epochs2026.0471.1
UPopReduce Ratio=0.7, GFLOPS=39.93, Backbone=BLIP2024.0368.71
UPopReduce Ratio=0.8, GFLOPS=19.08, Backbone=BLIP2024.0357.17