Visual Language Understanding on VLU Evaluation Suite
47.6MemoryCBLIND-VALM-M
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| BLIND-VALM-MModel Setup=Increased model size (MEDIUM)2024.09 | 47.6 | 48.93 | 24.09 | 43.33 | 24.36 | 24.93 | 35.54 | |
| BLIND-VALMModel Setup=Standard setup2024.09 | 47.2 | 46.37 | 22.6 | 40.07 | 25.43 | 25.18 | 34.47 | |
| VALMModel Setup=Original VALM baseline2024.09 | 47.09 | 41.88 | 20.46 | 40.45 | 26.03 | 23.94 | 33.3 | |
| BLIND-VALM+Model Setup=Increased pre-training compute2024.09 | 45.97 | 48.71 | 20.51 | 43.64 | 25.33 | 25.4 | 34.93 |