Object Localisation on PVOC subset with <= 3 objects 2007 (test)
45mIoUPIN
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PINVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 45 | 27 | 62 | |
| LoRA on φvVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 44 | 26 | 62 | |
| PINVLM Backbone=BLIP-2, Method category=PEFT2024.02 | 44 | 24 | 63 | |
| VPT on φvVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 42 | 21 | 61 | |
| VPT on FVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 34 | 16 | 51 | |
| VPT on FVLM Backbone=BLIP-2, Method category=PEFT2024.02 | 33 | 12 | 51 | |
| VPT on φvVLM Backbone=BLIP-2, Method category=PEFT2024.02 | 32 | 12 | 50 | |
| CoOp on LLMVLM Backbone=OpenFlamingo, Method category=PEFT2024.02 | 28 | 11 | 43 | |
| randomVLM Backbone=OpenFlamingo, Method category=Baselines2024.02 | 22 | 10 | 33 | |
| 10 contextVLM Backbone=OpenFlamingo, Method category=Baselines, context_images=102024.02 | 20 | 6 | 32 | |
| 2 contextVLM Backbone=OpenFlamingo, Method category=Baselines, context_images=22024.02 | 19 | 8 | 30 | |
| 5 contextVLM Backbone=OpenFlamingo, Method category=Baselines, context_images=52024.02 | 19 | 7 | 31 | |
| rawVLM Backbone=OpenFlamingo, Method category=Baselines2024.02 | 0 | 0 | 0 |