Multimodal Perception on MME perception-related tasks
195ExistenceHIME
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HIMEBackbone=LLaVA-1.52026.02 | 195 | 155.56 | 123.33 | 151.67 | 130.27 | 135.59 | 154.5 | 161.67 | 120.75 | 125 | — | |
| DAMOModel=LLaVA1.5, Decoding=DAMO2025.08 | 195 | 150 | 143.3 | 165 | 144.6 | 134.1 | 157.8 | 163.8 | 120 | 140 | 1,513.5 | |
| NulluBackbone=LLaVA-1.52026.02 | 190 | 121.11 | 105.56 | 156.67 | 127.55 | 115.59 | 147.92 | 131.66 | 113 | 121.67 | — | |
| VanillaModel=LLaVA1.5, Decoding=Vanilla2025.08 | 190 | 160 | 138.3 | 165 | 140.5 | 135 | 156.3 | 162.3 | 119.3 | 125 | 1,491.6 | |
| VCDModel=LLaVA1.5, Decoding=VCD2025.08 | 190 | 148.3 | 118.3 | 148.3 | 131.6 | 151.8 | 150.3 | 165.3 | 125.5 | 130 | 1,459.4 | |
| DCLAModel=LLaVA1.5, Decoding=DCLA2025.08 | 190 | 163.3 | 148.3 | 175 | 137.4 | 132.1 | 156.3 | 160.5 | 117.3 | 140 | 1,520.1 | |
| SPINModel=LLaVA1.5, Decoding=SPIN2025.08 | 190 | 163.3 | 133.3 | 170 | 141.5 | 132.9 | 157.5 | 165.3 | 123 | 125 | 1,501.9 | |
| HGAIModel=LLaVA1.5, Decoding=HGAI2025.08 | 190 | 160 | 138.3 | 165 | 140.5 | 135 | 156.3 | 160.8 | 118.5 | 125 | 1,489.3 | |
| MAPModel=LLaVA1.5, Decoding=MAP2025.08 | 190 | 165 | 143.3 | 170 | 142.5 | 138.2 | 159.3 | 165.3 | 115.8 | 140 | 1,529.3 | |
| VanillaModel=mPLUG-Owl2, Decoding=Vanilla2025.08 | 185 | 165 | 78.3 | 150 | 163.3 | 162.9 | 152.8 | 160 | 139.8 | 102.5 | 1,459.5 | |
| DAMOModel=mPLUG-Owl2, Decoding=DAMO2025.08 | 185 | 160 | 93.3 | 150 | 163.3 | 163.8 | 153.8 | 161.5 | 139 | 95 | 1,464.7 | |
| DCLAModel=mPLUG-Owl2, Decoding=DCLA2025.08 | 185 | 165 | 78.3 | 155 | 162.2 | 163.8 | 153 | 159.5 | 139 | 102.5 | 1,463.4 | |
| SPINModel=mPLUG-Owl2, Decoding=SPIN2025.08 | 185 | 160 | 68.3 | 160 | 160.2 | 166.2 | 158.3 | 160 | 136.5 | 102.5 | 1,457 | |
| HGAIModel=mPLUG-Owl2, Decoding=HGAI2025.08 | 185 | 165 | 86.7 | 150 | 157.1 | 162.4 | 153.5 | 160.8 | 136.5 | 102.5 | 1,459.4 | |
| MAPModel=mPLUG-Owl2, Decoding=MAP2025.08 | 185 | 165 | 83.3 | 155 | 160.2 | 163.5 | 153.3 | 162.5 | 135.8 | 102.5 | 1,466.4 | |
| VanillaModel=InstructBLIP, Decoding=Vanilla2025.08 | 185 | 58.3 | 58.3 | 143.3 | 152.7 | 154.7 | 160.8 | 165.8 | 112.5 | 80 | 1,271.4 | |
| DAMOModel=InstructBLIP, Decoding=DAMO2025.08 | 185 | 78.3 | 68.3 | 143.3 | 149 | 155.3 | 157.3 | 159.3 | 116.3 | 87.5 | 1,299.5 | |
| DCLAModel=InstructBLIP, Decoding=DCLA2025.08 | 185 | 73.3 | 68.3 | 143.3 | 149.7 | 157.6 | 158 | 157.3 | 119.5 | 87.5 | 1,299.6 | |
| SPINModel=InstructBLIP, Decoding=SPIN2025.08 | 185 | 86.7 | 63.3 | 143.3 | 141.2 | 152.9 | 159.8 | 160.3 | 114.3 | 87.5 | 1,294.2 | |
| HGAIModel=InstructBLIP, Decoding=HGAI2025.08 | 185 | 58.3 | 56.7 | 143.3 | 152.7 | 153.8 | 159 | 165 | 111 | 80 | 1,264.9 | |
| MAPModel=InstructBLIP, Decoding=MAP2025.08 | 185 | 70 | 63.3 | 143.3 | 147.3 | 158.5 | 159.5 | 165.8 | 115 | 95 | 1,302.7 | |
| OriginalBackbone=LLaVA-1.52026.02 | 181.67 | 118.33 | 104.44 | 152.78 | 117.23 | 111.67 | 144.83 | 130.65 | 108.92 | 75.83 | — | |
| VCDModel=mPLUG-Owl2, Decoding=VCD2025.08 | 175 | 145 | 83.3 | 150 | 149.3 | 162.4 | 151 | 147.8 | 135.3 | 95 | 1,394 | |
| VCDModel=InstructBLIP, Decoding=VCD2025.08 | 145 | 68.3 | 63.3 | 140 | 117 | 127.1 | 149.3 | 133.8 | 107 | 63.3 | 1,153.2 |