List your company
ResearchFormerly WizWand

Science Question Answering on SQA (Score, Relative Performance)

70.15ScoreVanilla
67.18667.955568.72569.4945Nov 25, 2025Dec 31, 2025Feb 5, 2026Mar 13, 2026Apr 18, 2026May 24, 2026Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
VanillaModel=LLaVA-NeXT, TFLOPs=100%2026.0670.15100
VTW (K=16)Model=LLaVA-NeXT, TFLOPs=51%2026.067086.5
Ours (N=20)Model=LLaVA-NeXT, TFLOPs=67%2026.0669.9698.8
V2DropModel=LLaVA-NeXT, TFLOPs=70%2026.0669.9298.4
VSkip+ (N=20)Model=LLaVA-NeXT, TFLOPs=74%2026.0669.8398.2
APETModel=LLaVA-NeXT, TFLOPs=70%2026.0669.7199.4
OC-VTPTokens=640, Retaining Ratio=22.2%, Backbone=LLaVA-NeXT2025.1169.3103
OC-VTPTokens=640, Retaining Ratio=22.2%, Individual Training=true, Backbone=LLaVA-NeXT2025.1169.3103
ShortV (N=20)Model=LLaVA-NeXT, TFLOPs=51%2026.0669.2696
OC-VTPTokens=160, Retaining Ratio=5.6%, Backbone=LLaVA-NeXT2025.1169.2103
VisionZipTokens=160, Retaining Ratio=5.6%, Backbone=LLaVA-NeXT2025.1169102
OC-VTPTokens=160, Retaining Ratio=5.6%, Individual Training=true, Backbone=LLaVA-NeXT2025.1169102
HiPruneTokens=160, Retaining Ratio=5.6%, Backbone=LLaVA-NeXT2025.1168.7102
VisionZipTokens=640, Retaining Ratio=22.2%, Backbone=LLaVA-NeXT2025.1168.1101
HiPruneTokens=640, Retaining Ratio=22.2%, Backbone=LLaVA-NeXT2025.1168101
VanillaTokens=2880, Retaining Ratio=100%, Backbone=LLaVA-NeXT2025.1167.5100
OC-VTPTokens=320, Retaining Ratio=11.1%, Backbone=LLaVA-NeXT2025.1167.499.9
VisionZipTokens=320, Retaining Ratio=11.1%, Backbone=LLaVA-NeXT2025.1167.399.7
HiPruneTokens=320, Retaining Ratio=11.1%, Backbone=LLaVA-NeXT2025.1167.399.7
OC-VTPTokens=320, Retaining Ratio=11.1%, Individual Training=true, Backbone=LLaVA-NeXT2025.1167.399.7