VSR
Benchmarks
TaskDatasetSOTA resultTrendResults
VSR
88.87Accuracy
62
VSR
92.61LLM-Judge Accuracy
28
VSR
73.77Top-1 Accuracy
26
VSR
73.9Overall Accuracy
17
VSR
85.7Accuracy
16
VSR
75.6Accuracy
10
VSR (ood)
84.8Accuracy
10
VSR (Visual Spatial Reasoning)
75.8Binary Robust Acc
9
VSR (test)
81.05Accuracy
9
VSR zeroshot
69.25Accuracy
8
VSR
70.14Accuracy
8
VSR (n=240)
96.8DAE
8
VSR ZOOM-Hard
55.98GPT Accuracy
6
VSR ZOOM-Medium
67.63GPT Accuracy
6
VSR (ZOOM-Easy)
73.09GPT Accuracy
6
VSR (test)
67.4AUROC
6
VSR zero-shot (test)
63.67Accuracy (zero-shot)
6
VSR
80.6Score
3
VSR-120K
100Trainable Params
1