Counterfactual Inference on CFInfer
38AccuracyOriginal Model
Evaluation Results
| Method | Links | |
|---|---|---|
| Original ModelBackbone=LLaVA-1.5-13B, Retention Ratio=1.02025.12 | 38 | |
| TrimTokenator-LCBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 38 | |
| SparseVLMBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 37 | |
| DivPruneBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 37 | |
| VisionZipBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 36.5 | |
| TrimTokenatorBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 36.5 | |
| Original ModelBackbone=Yi-VL-6B, Retention Ratio=1.02025.12 | 36.5 | |
| VTWBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 34.5 | |
| FastVBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 34 | |
| CATPBackbone=LLaVA-1.5-13B, Retention Ratio=0.22025.12 | 34 | |
| TrimTokenator-LCBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 34 | |
| DivPruneBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 33 | |
| VisionZipBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 32.5 | |
| TrimTokenatorBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 32.5 | |
| SparseVLMBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 32 | |
| VTWBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 31.5 | |
| CATPBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 31.5 | |
| FastVBackbone=Yi-VL-6B, Retention Ratio=0.22025.12 | 31 | |
| Original ModelBackbone=LLaVA-1.5-7B, Retention Ratio=1.02025.12 | 30.5 | |
| Original ModelBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 30 | |
| TrimTokenator-LCBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 30 | |
| FastVBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 28.5 | |
| VisionZipBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 28.5 | |
| SparseVLMBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 28 | |
| VTWBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 27.5 | |
| DivPruneBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 26.5 | |
| TrimTokenatorBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 26 | |
| CATPBase Model=InternVL-Chat-ViT-6B-Vicuna-13B2025.12 | 25 | |
| TrimTokenator-LCBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 25 | |
| TrimTokenatorBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 23.5 | |
| SparseVLMBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 23 | |
| FastVBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 22.5 | |
| VisionZipBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 22.5 | |
| DivPruneBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 22.5 | |
| VTWBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 22 | |
| CATPBackbone=LLaVA-1.5-7B, Retention Ratio=0.22025.12 | 21 |