ResearchBenchmarksVision Language Model Inference on InternVL 3Vision Language Model Inference on InternVL 3Follow166Latency (ms)RoME165.68167.84170172.16Apr 10, 2026Evaluation resultsMethodMethodLinksLatency (ms)SpeedupRoMEModel=internvl3, Param...Model=internvl3, Parameters=8B, QKShape[BNSD]=[1, 28, 1846, 128]2026.041664.5RoPEModel=internvl3, Param...Model=internvl3, Parameters=8B, QKShape[BNSD]=[1, 28, 1846, 128]2026.04174—