ResearchBenchmarksEfficiency Analysis on Standard Transformer PipelineEfficiency Analysis on Standard Transformer PipelineFollow5.973TFLOPsVanilla0.4330241.8712873.309554.747813Feb 3, 2026Evaluation resultsMethodMethodLinksTFLOPsMFLOPs CountPrefill Latency (ms)VanillaAvg Token=576Avg Token=5762026.025.9730124FastVAvg Token=64Avg Token=642026.020.83414.718592SparseVLMAvg Token=64Avg Token=642026.020.81415.505104NuwaAvg Token=64Avg Token=642026.020.647617.563646VisionZipAvg Token=64Avg Token=642026.020.64618.912845