List your company
ResearchFormerly WizWand

Visual Question Answering on RealWorldQA 1.0 (test)

0.6353AccuracySCL
0.4884520.5265760.56470.602824Oct 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
SCLBackbone=MiniCPM-Llama3-V2.5, Strategy=SCL, Rank=12024.100.6353
SFTBackbone=MiniCPM-Llama3-V2.5, Strategy=SFT, Rank=22024.100.6235
SCLBackbone=InternLM-XComposer-2-7B, Strategy=SCL, Rank=1.132024.100.6223
SFTBackbone=InternLM-XComposer-2-7B, Strategy=SFT, Rank=1.752024.100.6203
MiniCPM-Llama3-V2.5Backbone=MiniCPM-Llama3-V2.5, Strategy=Base, Rank=32024.100.617
InternLM-XComposer-2-7BBackbone=InternLM-XComposer-2-7B, Strategy=Base, Rank=32024.100.6045
SFTBackbone=LLaVA-V1.5-13B, Strategy=SFT, Rank=1.882024.100.5659
SCLBackbone=LLaVA-V1.5-13B, Strategy=SCL, Rank=1.382024.100.5603
LLaVA-V1.5-13BBackbone=LLaVA-V1.5-13B, Strategy=Base, Rank=2.752024.100.5485
SCLBackbone=LLaVA-V1.5-7B, Strategy=SCL, Rank=1.632024.100.5271
SFTBackbone=LLaVA-V1.5-7B, Strategy=SFT, Rank=32024.100.5221
POVIDBackbone=LLaVA-V1.5-7B, Strategy=POVID, Rank=3.252024.100.515
CSRBackbone=LLaVA-V1.5-7B, Strategy=CSR, Rank=4.252024.100.5103
LLaVA-V1.5-7BBackbone=LLaVA-V1.5-7B, Strategy=Base, Rank=4.52024.100.509
SIMABackbone=LLaVA-V1.5-7B, Strategy=SIMA, Rank=4.382024.100.4941