Instruction Following on ALFRED
19.84AccuracyTrimTokenator-LC
Evaluation Results
| Method | Links | |
|---|---|---|
| TrimTokenator-LCBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 19.84 | |
| DivPruneBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 18.76 | |
| TrimTokenatorBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 18.67 | |
| Original ModelBackbone=LLaVA-1.5-13B, Retention Ratio=1.02025.12 | 18.64 | |
| SparseVLMBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 18.35 | |
| VisionZipBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 18.17 | |
| TrimTokenator-LCBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 18.14 | |
| VTWBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 17.87 | |
| CATPBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 17.82 | |
| FastVBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 17.62 | |
| Full CacheArchitecture=Qwen3-VL, Parameter Scale=8B2026.04 | 16.62 | |
| H2OArchitecture=Qwen3-VL, Parameter Scale=8B2026.04 | 16.36 | |
| RetentiveKVArchitecture=Qwen3-VL, Parameter Scale=8B2026.04 | 16.34 | |
| Full CacheArchitecture=LLaVA-v1.5, Parameter Scale=7B2026.04 | 16.32 | |
| TrimTokenatorBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 16.25 | |
| LOOK-MArchitecture=Qwen3-VL, Parameter Scale=8B2026.04 | 16.22 | |
| SparseVLMBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 16.21 | |
| Original ModelBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 16.2 | |
| SAINTArchitecture=Qwen3-VL, Parameter Scale=8B2026.04 | 16.15 | |
| SnapKVArchitecture=Qwen3-VL, Parameter Scale=8B2026.04 | 16.12 | |
| TrimTokenator-LCBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 16.1 | |
| Original ModelBackbone=Yi-VL-6B, Retention Ratio=1.02025.12 | 16.02 | |
| MedaArchitecture=Qwen3-VL, Parameter Scale=8B2026.04 | 15.98 | |
| Full CacheArchitecture=Qwen3-VL, Parameter Scale=4B2026.04 | 15.98 | |
| RetentiveKVArchitecture=Qwen3-VL, Parameter Scale=4B2026.04 | 15.87 | |
| RetentiveKVArchitecture=LLaVA-v1.5, Parameter Scale=7B2026.04 | 15.82 | |
| VisionZipBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 15.76 | |
| SnapKVArchitecture=Qwen3-VL, Parameter Scale=4B2026.04 | 15.64 | |
| CATPBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 15.62 | |
| DivPruneBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 15.5 | |
| VTWBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 15.35 | |
| LOOK-MArchitecture=Qwen3-VL, Parameter Scale=4B2026.04 | 15.32 | |
| MedaArchitecture=Qwen3-VL, Parameter Scale=4B2026.04 | 15.26 | |
| DivPruneBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 15.23 | |
| SAINTArchitecture=Qwen3-VL, Parameter Scale=4B2026.04 | 15.19 | |
| FastVBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 15.17 | |
| TrimTokenatorBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 15.12 | |
| SparseVLMBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 14.94 | |
| MedaArchitecture=LLaVA-v1.5, Parameter Scale=7B2026.04 | 14.87 | |
| Original ModelBackbone=LLaVA-1.5-7B, Retention Ratio=1.02025.12 | 14.81 | |
| VisionZipBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 14.76 | |
| H2OArchitecture=Qwen3-VL, Parameter Scale=4B2026.04 | 14.67 | |
| SAINTArchitecture=LLaVA-v1.5, Parameter Scale=7B2026.04 | 14.64 | |
| SnapKVArchitecture=LLaVA-v1.5, Parameter Scale=7B2026.04 | 14.57 | |
| H2OArchitecture=LLaVA-v1.5, Parameter Scale=7B2026.04 | 14.49 | |
| LOOK-MArchitecture=LLaVA-v1.5, Parameter Scale=7B2026.04 | 14.33 | |
| CATPBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 14.15 | |
| FastVBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 13.73 | |
| VTWBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 13.62 | |
| TrimTokenator-LCBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 12.74 | |
| DivPruneBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 11.31 | |
| TrimTokenatorBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 11.26 | |
| VisionZipBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 11.18 | |
| SparseVLMBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 11.06 | |
| CATPBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 10.32 | |
| VTWBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 10.28 | |
| FastVBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 9.82 |