Object Recognition (Cross-Validation) on COCO (val)
1RecallGPT-4V Preview
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4V Previewprompt=instruct, top-k=102023.12 | 1 | 1 | 1 | |
| Ourstop-k=1002023.12 | 0.823 | 0.473 | 0.6 | |
| Ourstop-k=102023.12 | 0.632 | 0.651 | 0.641 | |
| LLAVA_1.0prompt=caption, top-k=102023.12 | 0.593 | 0.599 | 0.595 | |
| LLAVA_1.5prompt=caption, top-k=102023.12 | 0.576 | 0.572 | 0.573 | |
| CaSEDtop-k=102023.12 | 0.535 | 0.562 | 0.546 | |
| Flamingo_open w/ MPTprompt=list, top-k=102023.12 | 0.517 | 0.76 | 0.609 | |
| InstructBLIPprompt=list, top-k=102023.12 | 0.505 | 0.731 | 0.594 | |
| BLIP-2prompt=caption, top-k=102023.12 | 0.498 | 0.736 | 0.59 | |
| CLIPtop-k=102023.12 | 0.467 | 0.509 | 0.485 |