# Multi-modal Evaluation on MME (Score Metric)

Source: [Multi-modal Evaluation on MME (Score Metric)](<https://www.sota2.com/research/sota/multi-modal-evaluation-on-mme-score-metric>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-09T07:11:32.425Z

Evaluation of multi-modal reasoning capabilities using the MME dataset, specifically reporting the overall 'Score' metric.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-modal Evaluation |
| Dataset (including any stated split) | MME |
| Metric | MME Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 240 of 240 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MME Score](<https://www.sota2.com/research/sota/multi-modal-evaluation-on-mme-score-metric.md?metric=MME%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | MME Score | Result date | Report paper |
| --- | --- | --- | --- |
| InternVL3-8B | 2389.7 | Not recorded | 6a449f0ae0224bd4f499303d |
| Qwen3-VL-4B | 2371.74 | Not recorded | 69eeed6955a3c32af89f9647 |
| Vanilla | 2307 | Not recorded | 69e7048c7d0172140ec7eca7 |
| Vanilla | 2306 | Not recorded | 69e704dd7d0172140ec7f08c |
| DART | 2280.4 | Not recorded | 6a449f0ae0224bd4f499303d |
| ERA | 2251.7 | Not recorded | 6a449f0ae0224bd4f499303d |
| VisionZip | 2192 | Not recorded | 6a449f0ae0224bd4f499303d |
| DivPrune | 2188.7 | Not recorded | 6a449f0ae0224bd4f499303d |
| DART | 2180.4 | Not recorded | 6a449f0ae0224bd4f499303d |
| Qwen2.5-VL-3B | 2144.75 | Not recorded | 69eeed6955a3c32af89f9647 |
| InfiniteVL-4B | 2126 | Not recorded | 69eeed6955a3c32af89f9647 |
| HalfV | 2124 | Not recorded | 69e7048c7d0172140ec7eca7 |
| ERA | 2119.2 | Not recorded | 6a449f0ae0224bd4f499303d |
| DASH | 2109 | Not recorded | 69e704dd7d0172140ec7f08c |
| LLaVA-OV-Pt + IRA | 2109 | Not recorded | 6a45f087dc71372d7795a268 |
| FastV | 2101 | Not recorded | 69e704dd7d0172140ec7f08c |
| Qwen3VL-2B-SFT | 2087.55 | Not recorded | 6a1e63c1dbd7150506f85369 |
| DART | 2086 | Not recorded | 69e7048c7d0172140ec7eca7 |
| InternVL2-4B | 2064.6 | Not recorded | 69eeed6955a3c32af89f9647 |
| VisionZip | 2058 | Not recorded | 69e704dd7d0172140ec7f08c |
| DART | 2056 | Not recorded | 69e704dd7d0172140ec7f08c |
| PruMerge+ | 2044 | Not recorded | 69e704dd7d0172140ec7f08c |
| DivPrune | 2043 | Not recorded | 6a449f0ae0224bd4f499303d |
| InternVL2.5-Pt + IRA | 2038 | Not recorded | 6a45f087dc71372d7795a268 |
| LLaVA-OV-Pt + SFT | 2030 | Not recorded | 6a45f087dc71372d7795a268 |
| HoloV | 2006 | Not recorded | 69e7048c7d0172140ec7eca7 |
| VisionZip | 1987.8 | Not recorded | 6a449f0ae0224bd4f499303d |
| LLaVA-OneVision-7B | 1987.63 | Not recorded | 69eeed6955a3c32af89f9647 |
| SpB2.0-VL-5B | 1981.99 | Not recorded | 69eeed6955a3c32af89f9647 |
| InternVL2.5-Pt + SFT | 1981 | Not recorded | 6a45f087dc71372d7795a268 |
| InternVL2-Pt + IRA | 1959 | Not recorded | 6a45f087dc71372d7795a268 |
| FastV | 1940 | Not recorded | 69e7048c7d0172140ec7eca7 |
| DASH | 1928 | Not recorded | 69e704dd7d0172140ec7f08c |
| DART | 1903 | Not recorded | 69e704dd7d0172140ec7f08c |
| DASH | 1901 | Not recorded | 69e704dd7d0172140ec7f08c |
| EVIAN | 1876.89 | Not recorded | 69e9a78a55a3c32af89f7032 |
| FastV | 1866 | Not recorded | 69e704dd7d0172140ec7f08c |
| Vanilla | 1862 | Not recorded | 68fa78871e209131cea78dd7 |
| Vanilla | 1862 | Not recorded | 69afa56b2d603e6de3e438e3 |
| MoB (+ η-prior) | 1860 | Not recorded | 68fa78871e209131cea78dd7 |
| MoB (w/o η-prior) | 1858 | Not recorded | 68fa78871e209131cea78dd7 |
| DART | 1856 | Not recorded | 68fa78871e209131cea78dd7 |
| DART | 1856 | Not recorded | 69afa56b2d603e6de3e438e3 |
| Vanilla | 1851 | Not recorded | 699d30ab6017c4460ffab633 |
| Vanilla | 1851 | Not recorded | 68fa78871e209131cea78dd7 |
| LLaVA-NeXT-7B | 1851 | Not recorded | 69ddca487d0172140ec79c86 |
| MoB (+ η-prior) | 1845 | Not recorded | 68fa78871e209131cea78dd7 |
| MoB (w/o η-prior) | 1842 | Not recorded | 68fa78871e209131cea78dd7 |
| ETC | 1840.46 | Not recorded | 6a1e63c1dbd7150506f85369 |
| ETC | 1840.24 | Not recorded | 6a1e63c1dbd7150506f85369 |
| DART | 1840 | Not recorded | 68fa78871e209131cea78dd7 |
| DART | 1840 | Not recorded | 69afa56b2d603e6de3e438e3 |
| PriorTR | 1839 | Not recorded | 6a3b6484206542251d7c966d |
| ETC | 1838.02 | Not recorded | 6a1e63c1dbd7150506f85369 |
| PriorTR | 1823 | Not recorded | 6a3b6484206542251d7c966d |
| HoloV | 1820 | Not recorded | 69afa56b2d603e6de3e438e3 |
| VisionZip | 1819 | Not recorded | 69e704dd7d0172140ec7f08c |
| Vanilla | 1818 | Not recorded | 68fa760f1e209131cea6b33b |
| Vanilla | 1816 | Not recorded | 6a3b6484206542251d7c966d |
| ApET | 1815 | Not recorded | 699d30ab6017c4460ffab633 |
| SCALE | 1814.97 | Not recorded | 69e9a78a55a3c32af89f7032 |
| BLIP-2 | 1810.34 | Not recorded | 69e9a78a55a3c32af89f7032 |
| MoB (w/o η-prior) | 1806 | Not recorded | 68fa78871e209131cea78dd7 |
| MoB (+ η-prior) | 1806 | Not recorded | 68fa78871e209131cea78dd7 |
| HoloV | 1802 | Not recorded | 69afa56b2d603e6de3e438e3 |
| PDrop | 1797 | Not recorded | 69afa56b2d603e6de3e438e3 |
| PruMerge+ | 1794 | Not recorded | 69e704dd7d0172140ec7f08c |
| InternVL2-Pt + SFT | 1792 | Not recorded | 6a45f087dc71372d7795a268 |
| PRUNESID | 1791 | Not recorded | 69afa56b2d603e6de3e438e3 |
| AutoSelect | 1791 | Not recorded | 69afa56b2d603e6de3e438e3 |
| FlowCut | 1791 | Not recorded | 69ddca487d0172140ec79c86 |
| VisionZip ‡ | 1790 | Not recorded | 68fa760f1e209131cea6b33b |
| VisionZip | 1787 | Not recorded | 699d30ab6017c4460ffab633 |
| MustDrop | 1787 | Not recorded | 68fa78871e209131cea78dd7 |
| PDrop | 1786 | Not recorded | 6a3b6484206542251d7c966d |
| ApET | 1783 | Not recorded | 699d30ab6017c4460ffab633 |
| VisionZip | 1783 | Not recorded | 69afa56b2d603e6de3e438e3 |
| PDrop | 1781 | Not recorded | 699d30ab6017c4460ffab633 |
| DeSAP | 1781 | Not recorded | 69ddca487d0172140ec79c86 |
| DART | 1774 | Not recorded | 69e704dd7d0172140ec7f08c |

### InternVL3-8B

MME Score: 2389.7. Result ID: 6a44d2aa73d097d845bfa0e6.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"1280","Reduction Ratio":"0%"}. This record does not assert independent reproduction.

### Qwen3-VL-4B

MME Score: 2371.74. Result ID: 69ef10e047f34ce924d4e9c0.

[Reporting paper](<https://www.sota2.com/research/paper/69eeed6955a3c32af89f9647.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Model":"Qwen3-VL","Parameter Count":"4B"}. This record does not assert independent reproduction.

### Vanilla

MME Score: 2307. Result ID: 69e725da47f34ce924ccf2f1.

[Reporting paper](<https://www.sota2.com/research/paper/69e7048c7d0172140ec7eca7.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2-VL-7B","Flops Ratio Reduction":"0%"}. This record does not assert independent reproduction.

### Vanilla

MME Score: 2306. Result ID: 69e76f3247f34ce924cf1308.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"0% (Upper Bound)"}. This record does not assert independent reproduction.

### DART

MME Score: 2280.4. Result ID: 6a44d2aa73d097d845bfa0e9.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79461e209131cea7cfd7.md>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"256","Reduction Ratio":"80.0%"}. This record does not assert independent reproduction.

### ERA

MME Score: 2251.7. Result ID: 6a44d2aa73d097d845bfa0ea.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"256","Reduction Ratio":"80.0%"}. This record does not assert independent reproduction.

### VisionZip

MME Score: 2192. Result ID: 6a44d2aa73d097d845bfa0e8.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa760f1e209131cea6b33b.md>)

[Implementation](<https://github.com/dvlab-research/VisionZip>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"256","Reduction Ratio":"80.0%"}. This record does not assert independent reproduction.

### DivPrune

MME Score: 2188.7. Result ID: 6a44d2aa73d097d845bfa0e7.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77c41e209131cea7532a.md>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"256","Reduction Ratio":"80.0%"}. This record does not assert independent reproduction.

### DART

MME Score: 2180.4. Result ID: 6a44d2aa73d097d845bfa0ed.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79461e209131cea7cfd7.md>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"128","Reduction Ratio":"90.0%"}. This record does not assert independent reproduction.

### Qwen2.5-VL-3B

MME Score: 2144.75. Result ID: 69ef10e047f34ce924d4e9bf.

[Reporting paper](<https://www.sota2.com/research/paper/69eeed6955a3c32af89f9647.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-VL","Parameter Count":"3B"}. This record does not assert independent reproduction.

### InfiniteVL-4B

MME Score: 2126. Result ID: 69ef10e047f34ce924d4e9c6.

[Reporting paper](<https://www.sota2.com/research/paper/69eeed6955a3c32af89f9647.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6938fe986cfd488761a53daf.md>)

[Implementation](<https://github.com/hustvl/InfiniteVL>)

Recorded evaluation configuration: {"Model":"InfiniteVL","Parameter Count":"4B","Result Source":"InfiniteVL (Tao et al., 2025) paper"}. This record does not assert independent reproduction.

### HalfV

MME Score: 2124. Result ID: 69e725da47f34ce924ccf2f5.

[Reporting paper](<https://www.sota2.com/research/paper/69e7048c7d0172140ec7eca7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e7048c7d0172140ec7eca7.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2-VL-7B","Flops Ratio Reduction":"88.9%"}. This record does not assert independent reproduction.

### ERA

MME Score: 2119.2. Result ID: 6a44d2aa73d097d845bfa0ee.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"128","Reduction Ratio":"90.0%"}. This record does not assert independent reproduction.

### DASH

MME Score: 2109. Result ID: 69e76f3247f34ce924cf130d.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"75.00%"}. This record does not assert independent reproduction.

### LLaVA-OV-Pt + IRA

MME Score: 2109. Result ID: 6a461e4d60b88bb33984d1d3.

[Reporting paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-OV","Training stage":"IRA"}. This record does not assert independent reproduction.

### FastV

MME Score: 2101. Result ID: 69e76f3247f34ce924cf1309.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b7.md>)

Recorded evaluation configuration: {"Token Reduction":"75.00%"}. This record does not assert independent reproduction.

### Qwen3VL-2B-SFT

MME Score: 2087.55. Result ID: 6a1e935cfbc373592c18af78.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e63c1dbd7150506f85369.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Tokens":"-"}. This record does not assert independent reproduction.

### DART

MME Score: 2086. Result ID: 69e725da47f34ce924ccf2f3.

[Reporting paper](<https://www.sota2.com/research/paper/69e7048c7d0172140ec7eca7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79461e209131cea7cfd7.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2-VL-7B","Flops Ratio Reduction":"88.9%"}. This record does not assert independent reproduction.

### InternVL2-4B

MME Score: 2064.6. Result ID: 69ef10e047f34ce924d4e9c1.

[Reporting paper](<https://www.sota2.com/research/paper/69eeed6955a3c32af89f9647.md>)

Recorded evaluation configuration: {"Model":"InternVL2","Parameter Count":"4B","Result Source":"OpenVLM Leaderboard (OpenCompass, 2025)"}. This record does not assert independent reproduction.

### VisionZip

MME Score: 2058. Result ID: 69e76f3247f34ce924cf130a.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"75.00%"}. This record does not assert independent reproduction.

### DART

MME Score: 2056. Result ID: 69e76f3247f34ce924cf130c.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"75.00%"}. This record does not assert independent reproduction.

### PruMerge+

MME Score: 2044. Result ID: 69e76f3247f34ce924cf130b.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"75.00%"}. This record does not assert independent reproduction.

### DivPrune

MME Score: 2043. Result ID: 6a44d2aa73d097d845bfa0eb.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77c41e209131cea7532a.md>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"128","Reduction Ratio":"90.0%"}. This record does not assert independent reproduction.

### InternVL2.5-Pt + IRA

MME Score: 2038. Result ID: 6a461e4d60b88bb33984d1d0.

[Reporting paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

Recorded evaluation configuration: {"Backbone":"InternVL2.5","Training stage":"IRA"}. This record does not assert independent reproduction.

### LLaVA-OV-Pt + SFT

MME Score: 2030. Result ID: 6a461e4d60b88bb33984d1d2.

[Reporting paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa756f1e209131cea67e58.md>)

[Implementation](<https://llava-vl.github.io/blog/llava-onevision>)

Recorded evaluation configuration: {"Backbone":"LLaVA-OV","Training stage":"SFT"}. This record does not assert independent reproduction.

### HoloV

MME Score: 2006. Result ID: 69e725da47f34ce924ccf2f4.

[Reporting paper](<https://www.sota2.com/research/paper/69e7048c7d0172140ec7eca7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bad1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2-VL-7B","Flops Ratio Reduction":"88.9%"}. This record does not assert independent reproduction.

### VisionZip

MME Score: 1987.8. Result ID: 6a44d2aa73d097d845bfa0ec.

[Reporting paper](<https://www.sota2.com/research/paper/6a449f0ae0224bd4f499303d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa760f1e209131cea6b33b.md>)

[Implementation](<https://github.com/dvlab-research/VisionZip>)

Recorded evaluation configuration: {"Backbone":"InternVL3-8B","Retained Tokens":"128","Reduction Ratio":"90.0%"}. This record does not assert independent reproduction.

### LLaVA-OneVision-7B

MME Score: 1987.63. Result ID: 69ef10e047f34ce924d4e9c2.

[Reporting paper](<https://www.sota2.com/research/paper/69eeed6955a3c32af89f9647.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c031e209131cea8bdde.md>)

Recorded evaluation configuration: {"Model":"LLaVA-OneVision","Parameter Count":"7B"}. This record does not assert independent reproduction.

### SpB2.0-VL-5B

MME Score: 1981.99. Result ID: 69ef10e047f34ce924d4e9c7.

[Reporting paper](<https://www.sota2.com/research/paper/69eeed6955a3c32af89f9647.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69eeed6955a3c32af89f9647.md>)

Recorded evaluation configuration: {"Model":"SpB2.0-VL","Parameter Count":"5B"}. This record does not assert independent reproduction.

### InternVL2.5-Pt + SFT

MME Score: 1981. Result ID: 6a461e4d60b88bb33984d1cf.

[Reporting paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73081e209131cea59f8b.md>)

[Implementation](<https://github.com/OpenGVLab/InternVL>)

Recorded evaluation configuration: {"Backbone":"InternVL2.5","Training stage":"SFT"}. This record does not assert independent reproduction.

### InternVL2-Pt + IRA

MME Score: 1959. Result ID: 6a461e4d60b88bb33984d1cd.

[Reporting paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

Recorded evaluation configuration: {"Backbone":"InternVL2","Training stage":"IRA"}. This record does not assert independent reproduction.

### FastV

MME Score: 1940. Result ID: 69e725da47f34ce924ccf2f2.

[Reporting paper](<https://www.sota2.com/research/paper/69e7048c7d0172140ec7eca7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b7.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2-VL-7B","Flops Ratio Reduction":"88.9%"}. This record does not assert independent reproduction.

### DASH

MME Score: 1928. Result ID: 69e76f3247f34ce924cf1312.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"88.89%"}. This record does not assert independent reproduction.

### DART

MME Score: 1903. Result ID: 69e76f3247f34ce924cf1311.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"88.89%"}. This record does not assert independent reproduction.

### DASH

MME Score: 1901. Result ID: 69e76f3247f34ce924cf1317.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"93.75%"}. This record does not assert independent reproduction.

### EVIAN

MME Score: 1876.89. Result ID: 69e9f9af47f34ce924d1f83a.

[Reporting paper](<https://www.sota2.com/research/paper/69e9a78a55a3c32af89f7032.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e9a78a55a3c32af89f7032.md>)

Recorded evaluation configuration: {"Data Selection Strategy":"10K subset"}. This record does not assert independent reproduction.

### FastV

MME Score: 1866. Result ID: 69e76f3247f34ce924cf130e.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74ae1e209131cea632b7.md>)

Recorded evaluation configuration: {"Token Reduction":"88.89%"}. This record does not assert independent reproduction.

### Vanilla

MME Score: 1862. Result ID: 69a92d8c6dbb7075b9521e3a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75051e209131cea65534.md>)

[Implementation](<https://github.com/PKU-YuanGroup/Video-LLaVA>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Token Reduction Rate":"0.0%"}. This record does not assert independent reproduction.

### Vanilla

MME Score: 1862. Result ID: 69afdbd26dbb7075b95850e4.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

Recorded evaluation configuration: {"Loc.":"-","Retained Tokens":"576","Pruning Ratio":"0%"}. This record does not assert independent reproduction.

### MoB (+ η-prior)

MME Score: 1860. Result ID: 69a92d8c6dbb7075b9521e40.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"-","Pruning budget K":"192","Token Reduction Rate":"66.7%"}. This record does not assert independent reproduction.

### MoB (w/o η-prior)

MME Score: 1858. Result ID: 69a92d8c6dbb7075b9521e3f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"PA VP","Pruning budget K":"192","Token Reduction Rate":"66.7%"}. This record does not assert independent reproduction.

### DART

MME Score: 1856. Result ID: 69a92d8c6dbb7075b9521e3e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79461e209131cea7cfd7.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"VP","Pruning budget K":"192","Token Reduction Rate":"66.7%"}. This record does not assert independent reproduction.

### DART

MME Score: 1856. Result ID: 69afdbd26dbb7075b95850e8.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79461e209131cea7cfd7.md>)

Recorded evaluation configuration: {"Loc.":"L2","Retained Tokens":"192","Pruning Ratio":"66.7%"}. This record does not assert independent reproduction.

### Vanilla

MME Score: 1851. Result ID: 699e57335698665ec417825d.

[Reporting paper](<https://www.sota2.com/research/paper/699d30ab6017c4460ffab633.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-NeXT-7B","Token Retention":"2880","Reduction Ratio":"100%"}. This record does not assert independent reproduction.

### Vanilla

MME Score: 1851. Result ID: 69a92d8c6dbb7075b9521e4d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75051e209131cea65534.md>)

[Implementation](<https://github.com/PKU-YuanGroup/Video-LLaVA>)

Recorded evaluation configuration: {"Backbone":"LLaVA-Next-7B","Token Reduction Rate":"0.0%"}. This record does not assert independent reproduction.

### LLaVA-NeXT-7B

MME Score: 1851. Result ID: 69de25ce47f34ce924c6a90e.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca487d0172140ec79c86.md>)

Recorded evaluation configuration: {"Base Model":"LLaVA-NeXT-7B","Retained Tokens":"2880","Pruning Ratio":"100%"}. This record does not assert independent reproduction.

### MoB (+ η-prior)

MME Score: 1845. Result ID: 69a92d8c6dbb7075b9521e46.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"-","Pruning budget K":"128","Token Reduction Rate":"77.8%"}. This record does not assert independent reproduction.

### MoB (w/o η-prior)

MME Score: 1842. Result ID: 69a92d8c6dbb7075b9521e45.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"PA VP","Pruning budget K":"128","Token Reduction Rate":"77.8%"}. This record does not assert independent reproduction.

### ETC

MME Score: 1840.46. Result ID: 6a1e935cfbc373592c18af7c.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e63c1dbd7150506f85369.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e63c1dbd7150506f85369.md>)

Recorded evaluation configuration: {"Tokens":"4"}. This record does not assert independent reproduction.

### ETC

MME Score: 1840.24. Result ID: 6a1e935cfbc373592c18af7f.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e63c1dbd7150506f85369.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e63c1dbd7150506f85369.md>)

Recorded evaluation configuration: {"Tokens":"2"}. This record does not assert independent reproduction.

### DART

MME Score: 1840. Result ID: 69a92d8c6dbb7075b9521e44.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79461e209131cea7cfd7.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"VP","Pruning budget K":"128","Token Reduction Rate":"77.8%"}. This record does not assert independent reproduction.

### DART

MME Score: 1840. Result ID: 69afdbd26dbb7075b95850f3.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79461e209131cea7cfd7.md>)

Recorded evaluation configuration: {"Loc.":"L2","Retained Tokens":"128","Pruning Ratio":"77.8%"}. This record does not assert independent reproduction.

### PriorTR

MME Score: 1839. Result ID: 6a3b8c89fbc373592c43f7fa.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b6484206542251d7c966d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a3b6484206542251d7c966d.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-13B","Retained Tokens":"192"}. This record does not assert independent reproduction.

### ETC

MME Score: 1838.02. Result ID: 6a1e935cfbc373592c18af82.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e63c1dbd7150506f85369.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e63c1dbd7150506f85369.md>)

Recorded evaluation configuration: {"Tokens":"1"}. This record does not assert independent reproduction.

### PriorTR

MME Score: 1823. Result ID: 6a3b8c89fbc373592c43f7ff.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b6484206542251d7c966d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a3b6484206542251d7c966d.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-13B","Retained Tokens":"128"}. This record does not assert independent reproduction.

### HoloV

MME Score: 1820. Result ID: 69afdbd26dbb7075b95850ed.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bad1.md>)

Recorded evaluation configuration: {"Loc.":"Pre","Retained Tokens":"192","Pruning Ratio":"66.7%"}. This record does not assert independent reproduction.

### VisionZip

MME Score: 1819. Result ID: 69e76f3247f34ce924cf130f.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"88.89%"}. This record does not assert independent reproduction.

### Vanilla

MME Score: 1818. Result ID: 69a1699535dfcabb00e6e466.

[Reporting paper](<https://www.sota2.com/research/paper/68fa760f1e209131cea6b33b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa732e1e209131cea5af59.md>)

[Implementation](<https://llava-vl.github.io/>)

Recorded evaluation configuration: {"Base Model":"LLaVA 1.5 13B","Tokens Retained":"576","Projector Fine-tuning":"false"}. This record does not assert independent reproduction.

### Vanilla

MME Score: 1816. Result ID: 6a3b8c89fbc373592c43f7f5.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b6484206542251d7c966d.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-13B","Retained Tokens":"576"}. This record does not assert independent reproduction.

### ApET

MME Score: 1815. Result ID: 699e57335698665ec4178261.

[Reporting paper](<https://www.sota2.com/research/paper/699d30ab6017c4460ffab633.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30ab6017c4460ffab633.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-NeXT-7B","Token Retention":"640","Reduction Ratio":"77.8%"}. This record does not assert independent reproduction.

### SCALE

MME Score: 1814.97. Result ID: 69e9f9af47f34ce924d1f838.

[Reporting paper](<https://www.sota2.com/research/paper/69e9a78a55a3c32af89f7032.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa793c1e209131cea7cc8d.md>)

Recorded evaluation configuration: {"Data Selection Strategy":"10K subset"}. This record does not assert independent reproduction.

### BLIP-2

MME Score: 1810.34. Result ID: 69e9f9af47f34ce924d1f837.

[Reporting paper](<https://www.sota2.com/research/paper/69e9a78a55a3c32af89f7032.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fb71e209131cea46fe6.md>)

[Implementation](<https://github.com/salesforce/LAVIS/tree/main/projects/blip2>)

Recorded evaluation configuration: {"Data Selection Strategy":"10K subset"}. This record does not assert independent reproduction.

### MoB (w/o η-prior)

MME Score: 1806. Result ID: 69a92d8c6dbb7075b9521e4b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"PA VP","Pruning budget K":"64","Token Reduction Rate":"88.9%"}. This record does not assert independent reproduction.

### MoB (+ η-prior)

MME Score: 1806. Result ID: 69a92d8c6dbb7075b9521e4c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"-","Pruning budget K":"64","Token Reduction Rate":"88.9%"}. This record does not assert independent reproduction.

### HoloV

MME Score: 1802. Result ID: 69afdbd26dbb7075b95850f8.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bad1.md>)

Recorded evaluation configuration: {"Loc.":"Pre","Retained Tokens":"128","Pruning Ratio":"77.8%"}. This record does not assert independent reproduction.

### PDrop

MME Score: 1797. Result ID: 69afdbd26dbb7075b95850ea.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa772c1e209131cea71934.md>)

Recorded evaluation configuration: {"Loc.":"L8–L24","Retained Tokens":"192","Pruning Ratio":"66.7%"}. This record does not assert independent reproduction.

### PruMerge+

MME Score: 1794. Result ID: 69e76f3247f34ce924cf1310.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"88.89%"}. This record does not assert independent reproduction.

### InternVL2-Pt + SFT

MME Score: 1792. Result ID: 6a461e4d60b88bb33984d1cc.

[Reporting paper](<https://www.sota2.com/research/paper/6a45f087dc71372d7795a268.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73081e209131cea59f8b.md>)

[Implementation](<https://github.com/OpenGVLab/InternVL>)

Recorded evaluation configuration: {"Backbone":"InternVL2","Training stage":"SFT"}. This record does not assert independent reproduction.

### PRUNESID

MME Score: 1791. Result ID: 69afdbd26dbb7075b95850ee.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

Recorded evaluation configuration: {"Loc.":"Pre","Retained Tokens":"192","Pruning Ratio":"66.7%"}. This record does not assert independent reproduction.

### AutoSelect

MME Score: 1791. Result ID: 69afdbd26dbb7075b95850ef.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

Recorded evaluation configuration: {"Loc.":"Pre","Retained Tokens":"192","Pruning Ratio":"66.7%"}. This record does not assert independent reproduction.

### FlowCut

MME Score: 1791. Result ID: 69de25ce47f34ce924c6a914.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca487d0172140ec79c86.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79321e209131cea7c92e.md>)

Recorded evaluation configuration: {"Base Model":"LLaVA-NeXT-7B","Retained Tokens":"320","Pruning Ratio":"88.9%"}. This record does not assert independent reproduction.

### VisionZip ‡

MME Score: 1790. Result ID: 69a1699535dfcabb00e6e468.

[Reporting paper](<https://www.sota2.com/research/paper/68fa760f1e209131cea6b33b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa760f1e209131cea6b33b.md>)

[Implementation](<https://github.com/dvlab-research/VisionZip>)

Recorded evaluation configuration: {"Base Model":"LLaVA 1.5 13B","Tokens Retained":"192","Projector Fine-tuning":"true"}. This record does not assert independent reproduction.

### VisionZip

MME Score: 1787. Result ID: 699e57335698665ec4178260.

[Reporting paper](<https://www.sota2.com/research/paper/699d30ab6017c4460ffab633.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa760f1e209131cea6b33b.md>)

[Implementation](<https://github.com/dvlab-research/VisionZip>)

Recorded evaluation configuration: {"Backbone":"LLaVA-NeXT-7B","Token Retention":"640","Reduction Ratio":"77.8%"}. This record does not assert independent reproduction.

### MustDrop

MME Score: 1787. Result ID: 69a92d8c6dbb7075b9521e3d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78871e209131cea78dd7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c41e209131cea69d42.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-7B","Objectives":"PA VP","Pruning budget K":"192","Token Reduction Rate":"66.7%"}. This record does not assert independent reproduction.

### PDrop

MME Score: 1786. Result ID: 6a3b8c89fbc373592c43f7f8.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b6484206542251d7c966d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa772c1e209131cea71934.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-1.5-13B","Retained Tokens":"192"}. This record does not assert independent reproduction.

### ApET

MME Score: 1783. Result ID: 699e57335698665ec4178265.

[Reporting paper](<https://www.sota2.com/research/paper/699d30ab6017c4460ffab633.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30ab6017c4460ffab633.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-NeXT-7B","Token Retention":"320","Reduction Ratio":"88.9%"}. This record does not assert independent reproduction.

### VisionZip

MME Score: 1783. Result ID: 69afdbd26dbb7075b95850ec.

[Reporting paper](<https://www.sota2.com/research/paper/69afa56b2d603e6de3e438e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa760f1e209131cea6b33b.md>)

[Implementation](<https://github.com/dvlab-research/VisionZip>)

Recorded evaluation configuration: {"Loc.":"Pre","Retained Tokens":"192","Pruning Ratio":"66.7%"}. This record does not assert independent reproduction.

### PDrop

MME Score: 1781. Result ID: 699e57335698665ec417825f.

[Reporting paper](<https://www.sota2.com/research/paper/699d30ab6017c4460ffab633.md>)

Recorded evaluation configuration: {"Backbone":"LLaVA-NeXT-7B","Token Retention":"640","Reduction Ratio":"77.8%"}. This record does not assert independent reproduction.

### DeSAP

MME Score: 1781. Result ID: 69de25ce47f34ce924c6a916.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca487d0172140ec79c86.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca487d0172140ec79c86.md>)

Recorded evaluation configuration: {"Base Model":"LLaVA-NeXT-7B","Retained Tokens":"320","Pruning Ratio":"88.9%"}. This record does not assert independent reproduction.

### DART

MME Score: 1774. Result ID: 69e76f3247f34ce924cf1316.

[Reporting paper](<https://www.sota2.com/research/paper/69e704dd7d0172140ec7f08c.md>)

Recorded evaluation configuration: {"Token Reduction":"93.75%"}. This record does not assert independent reproduction.

Page 1 of 3. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/sota/multi-modal-evaluation-on-mme-score-metric.md?metric=MME%20Score&page=2>): Follow this link to discover more pages.
