Text Multiple Choice Question Answering on MC-LLaVA
72.9Choice-T Accuracy (Single)MC-LLaVA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MC-LLaVAT (Tokens)=10^1, Auxiliary Loss=true2024.11 | 72.9 | 69.8 | 71.8 | |
| MC-LLaVAT (Tokens)=10^1, Auxiliary Loss=false2024.11 | 72.3 | 69.5 | 70.9 | |
| GPT4o+PromptT (Tokens)=10^12024.11 | 71.2 | 68 | 70.2 | |
| PeKitT (Tokens)=02024.11 | 71.2 | 65.7 | 69.2 | |
| RAP-MLLMT (Tokens)=10^22024.11 | 70.9 | 65.6 | 68.5 | |
| Yo'LLaVA-ST (Tokens)=10^12024.11 | 70.3 | — | 70.3 | |
| Yo'LLaVA-MT (Tokens)=10^12024.11 | 68.4 | 59.4 | 65.8 | |
| LLaVA+PromptT (Tokens)=10^22024.11 | 64.6 | 63 | 63.5 | |
| LLaVA+PromptT (Tokens)=10^12024.11 | 59.7 | 53.5 | 55.3 | |
| LLaVAT (Tokens)=02024.11 | 41.1 | 26.4 | 35.3 |