Vision-Language Evaluation Suite on LLaVa 1.5
63.01GQA ScoreRADIO-ViT-H/16
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RADIO-ViT-H/16Params (M)=653, Resolution=432, Throughput=1582023.12 | 63.01 | 86.2 | 56.32 | 79.28 | |
| OpenAI CLIP-L/14Params (M)=305, Resolution=336, Throughput=4142023.12 | 62.2 | 86.09 | 57.92 | 78.49 | |
| DINOv2-g/14-regParams (M)=1137, Resolution=224, Throughput=2942023.12 | 61.88 | 85.62 | 47.18 | 76.23 | |
| DFN CLIP-H/14Params (M)=633, Resolution=378, Throughput=1702023.12 | 61.73 | 85.91 | 56.78 | 78.78 | |
| E-RADIO-LParams (M)=391, Resolution=512, Throughput=4682023.12 | 61.7 | 85.07 | 51.47 | 76.73 | |
| Intern-ViT-6B (448)Params (M)=5537, Resolution=448, Throughput=142023.12 | 61.19 | 87.23 | 60.36 | 78.83 | |
| MetaCLIP-H/14Params (M)=632, Resolution=224, Throughput=4862023.12 | 60.57 | 84.76 | 53.65 | 75.71 | |
| Intern-ViT-6B (224)Params (M)=5902, Resolution=224, Throughput=632023.12 | 60.18 | 84.02 | 52.45 | 76.75 | |
| OpenCLIP-H/14Params (M)=632, Resolution=224, Throughput=5032023.12 | 57.94 | 83.61 | 50.48 | 72.24 | |
| SigLIP-L/14Params (M)=428, Resolution=384, Throughput=2412023.12 | 57.7 | 84.85 | 56.65 | 71.94 | |
| SAM-H/16Params (M)=637, Resolution=1024, Throughput=122023.12 | 49.92 | 81.76 | 43.91 | 57.65 |