Relational Reasoning on VSR
85.7AccuracyQWEN2.5-VL-7B + PGT
Evaluation results
| Method | Links | |
|---|---|---|
| QWEN2.5-VL-7B + PGTBackbone=QWEN2.5-VL-7B, Data=PGT-augmented2026.05 | 85.7 | |
| QWEN2.5-VL-7B + SPECIALIZED MIXBackbone=QWEN2.5-VL-7B, Data=Specialized Mix2026.05 | 85.5 | |
| IMAGE JIGSAWMethod=IMAGE JIGSAW2026.05 | 85.4 | |
| INTERNVL3-8B + PGTBackbone=INTERNVL3-8B, Data=PGT-augmented2026.05 | 85.3 | |
| INTERNVL3-8BBackbone=INTERNVL3-8B, Data=Original2026.05 | 85.2 | |
| QWEN2.5-VL-3B + PGTBackbone=QWEN2.5-VL-3B, Data=PGT-augmented2026.05 | 84 | |
| QWEN2.5-VL-7BBackbone=QWEN2.5-VL-7B, Data=Original2026.05 | 83.8 | |
| THINKLITE-VLMethod=THINKLITE-VL2026.05 | 83.3 | |
| QWEN2.5-VL-3B + SPECIALIZED MIXBackbone=QWEN2.5-VL-3B, Data=Specialized Mix2026.05 | 82.8 | |
| QWEN2.5-VL-3BBackbone=QWEN2.5-VL-3B, Data=Original2026.05 | 80.4 | |
| VIGORL-3BMethod=VIGORL-3B2026.05 | 74.1 | |
| LLAVA-NEXT-LLAMA3-8BBackbone=LLAVA-NEXT-LLAMA3-8B, Data=Original2026.05 | 71.8 | |
| LLAVA-NEXT-LLAMA3-8B + PGTBackbone=LLAVA-NEXT-LLAMA3-8B, Data=PGT-augmented2026.05 | 71.8 | |
| LLAVA-NEXT-7B + PGTBackbone=LLAVA-NEXT-7B, Data=PGT-augmented2026.05 | 70.9 | |
| LLAVA-NEXT-7BBackbone=LLAVA-NEXT-7B, Data=Original2026.05 | 64.7 | |
| SPATIAL-LADDER-3BMethod=SPATIAL-LADDER-3B2026.05 | 60.4 |