Object Localisation on COCO subset with <= 3 objects (test)
35mIoUPIN
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PINVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 35 | 26 | 59 | |
| PINVLM Backbone=BLIP-2, Method category=PEFT2024.02 | 34 | 22 | 60 | |
| VPT on φvVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 33 | 22 | 57 | |
| LoRA on φvVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 33 | 23 | 58 | |
| VPT on FVLM Backbone=BLIP-2, Method category=PEFT2024.02 | 27 | 12 | 50 | |
| VPT on FVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 26 | 15 | 47 | |
| VPT on φvVLM Backbone=BLIP-2, Method category=PEFT2024.02 | 26 | 11 | 48 | |
| CoOp on LLMVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 22 | 10 | 39 | |
| randomVLM Backbone=OpenFlamingo, Method category=Baselines2024.02 | 12 | 7 | 22 | |
| 2 contextVLM Backbone=OpenFlamingo, Method category=Baselines, context_images=22024.02 | 10 | 6 | 18 | |
| 5 contextVLM Backbone=OpenFlamingo, Method category=Baselines, context_images=52024.02 | 10 | 6 | 20 | |
| 10 contextVLM Backbone=OpenFlamingo, Method category=Baselines, context_images=102024.02 | 9 | 5 | 17 | |
| rawVLM Backbone=OpenFlamingo, Method category=Baselines2024.02 | 0 | 0 | 0 |