Multimodal Reasoning on SEED-BENCH
78.1AccuracyC-RADIOv4-H
Evaluation Results
| Method | Links | |
|---|---|---|
| C-RADIOv4-HTokens per frame/tile=256, TTFT (ms)=468.2, LLM Backbone=9B Nemotron2026.07 | 78.1 | |
| RADIO1DTokens per frame/tile=256, TTFT (ms)=452.8, LLM Backbone=9B Nemotron2026.07 | 77.9 | |
| RADIO1DTokens per frame/tile=224, TTFT (ms)=410.2, LLM Backbone=9B Nemotron2026.07 | 77.8 | |
| SigLIP2-SO400mTokens per frame/tile=256, TTFT (ms)=440.5, LLM Backbone=9B Nemotron2026.07 | 77.7 | |
| RADIO1DTokens per frame/tile=128, TTFT (ms)=373.2, LLM Backbone=9B Nemotron2026.07 | 77.6 | |
| RADIO1DTokens per frame/tile=192, TTFT (ms)=380.4, LLM Backbone=9B Nemotron2026.07 | 77.6 | |
| CoLTSize=8B, Backbone=Qwen3-VL-8B2026.06 | 77.5 | |
| SigLIP2-gTokens per frame/tile=256, TTFT (ms)=517.6, LLM Backbone=9B Nemotron2026.07 | 77.4 | |
| LLaVA-OneVision-1.5Size=8B2026.06 | 77.3 | |
| RADIO1DTokens per frame/tile=64, TTFT (ms)=346.1, LLM Backbone=9B Nemotron2026.07 | 76.9 | |
| Qwen3-VL (Textual reasoning)Size=8B2026.06 | 76.4 | |
| RADIO1DTokens per frame/tile=32, TTFT (ms)=335.1, LLM Backbone=9B Nemotron2026.07 | 76.3 | |
| RADIO1DTokens per frame/tile=8, TTFT (ms)=329.7, LLM Backbone=9B Nemotron2026.07 | 74.8 | |
| SIM-CoTSize=8B, Backbone=Qwen3-VL-8B2026.06 | 72.4 | |
| LVRSize=7B2026.06 | 71.2 | |
| RADIO1DTokens per frame/tile=1, TTFT (ms)=327.0, LLM Backbone=9B Nemotron2026.07 | 70 | |
| InternVL2-8B + RPRP fine-tuning=Object Replacement Data2024.08 | 69.9 | |
| InternVL2-8B-FTRP fine-tuning=None2024.08 | 69.5 | |
| SoftCoTSize=8B, Backbone=Qwen3-VL-8B2026.06 | 69.2 | |
| CODISize=8B, Backbone=Qwen3-VL-8B2026.06 | 68.6 | |
| LaCoTSize=7B2026.06 | 67.4 | |
| Qwen3-VL (Direct answer)Size=8B2026.06 | 66.2 | |
| ICoTSize=8B, Backbone=Qwen3-VL-8B2026.06 | 64.7 | |
| MGM-7BRP fine-tuning=None2024.08 | 63.5 | |
| CCoTSize=8B, Backbone=Qwen3-VL-8B2026.06 | 63.4 | |
| MGM-7B + RPRP fine-tuning=Object Replacement Data2024.08 | 63.2 | |
| Multimodal CoTSize=8B, Backbone=Qwen3-VL-8B2026.06 | 63.2 | |
| LLaVA-1.5-13B + MMFuserLLM=Vicuna-13B2024.10 | 62 | |
| LLaVA-1.5-7B + RPRP fine-tuning=Object Replacement Data2024.08 | 61.7 | |
| LLaVA-1.5-13BLLM=Vicuna-13B2024.10 | 61.6 | |
| LLaVA-1.5-7B + MMFuserLLM=Vicuna-7B2024.10 | 60.8 | |
| VanillaBackbone=LLaVA-1.5-7B, Visual Token Budget=5762026.06 | 59.3 | |
| LLaVA-1.5-7BLLM=Vicuna-7B2024.10 | 58.6 | |
| LLaVA-1.5-7BRP fine-tuning=None2024.08 | 58.6 | |
| Qwen-VL-ChatLLM=Qwen-7B2024.10 | 58.2 | |
| EvoCutBackbone=LLaVA-1.5-7B, Visual Token Budget=1922026.06 | 57.3 | |
| FastVBackbone=LLaVA-1.5-7B, Visual Token Budget=1922026.06 | 57.1 | |
| ApETBackbone=LLaVA-1.5-7B, Visual Token Budget=1922026.06 | 56.8 | |
| VisionZipBackbone=LLaVA-1.5-7B, Visual Token Budget=1922026.06 | 56.4 | |
| V2DropBackbone=LLaVA-1.5-7B, Visual Token Budget=1922026.06 | 56.4 | |
| Qwen-VLLLM=Qwen-7B2024.10 | 56.3 | |
| FastVBackbone=LLaVA-1.5-7B, Visual Token Budget=1282026.06 | 55.9 | |
| SparseVLMBackbone=LLaVA-1.5-7B, Visual Token Budget=1922026.06 | 55.8 | |
| EvoCutBackbone=LLaVA-1.5-7B, Visual Token Budget=1282026.06 | 55.2 | |
| VisionZipBackbone=LLaVA-1.5-7B, Visual Token Budget=1282026.06 | 54.9 | |
| PDropBackbone=LLaVA-1.5-7B, Visual Token Budget=1922026.06 | 54.7 | |
| ApETBackbone=LLaVA-1.5-7B, Visual Token Budget=1282026.06 | 54.7 | |
| V2DropBackbone=LLaVA-1.5-7B, Visual Token Budget=1282026.06 | 53.8 | |
| InstructBLIPLLM=Vicuna-7B2024.10 | 53.4 | |
| SparseVLMBackbone=LLaVA-1.5-7B, Visual Token Budget=1282026.06 | 53.4 | |
| PDropBackbone=LLaVA-1.5-7B, Visual Token Budget=1282026.06 | 53.3 | |
| EvoCutBackbone=LLaVA-1.5-7B, Visual Token Budget=642026.06 | 53.2 | |
| ApETBackbone=LLaVA-1.5-7B, Visual Token Budget=642026.06 | 52.4 | |
| VisionZipBackbone=LLaVA-1.5-7B, Visual Token Budget=642026.06 | 52.2 | |
| FastVBackbone=LLaVA-1.5-7B, Visual Token Budget=642026.06 | 51.9 | |
| V2DropBackbone=LLaVA-1.5-7B, Visual Token Budget=642026.06 | 51.4 | |
| SparseVLMBackbone=LLaVA-1.5-7B, Visual Token Budget=642026.06 | 51.1 | |
| BLIP-2LLM=Vicuna-13B2024.10 | 46.4 | |
| PDropBackbone=LLaVA-1.5-7B, Visual Token Budget=642026.06 | 40 |