Open-Vocabulary Entity Recognition on OVEN
0.789EMGPT4V
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT4VTemplate Type=minimal2025.04 | 0.789 | 0.789 | 0.81 | 0.704 | 0.85 | 0.871 | 0.886 | 0.876 | 0.168 | 0.282 | |
| QwenVLTemplate Type=minimal2025.04 | 0.502 | 0.502 | 0.651 | 0.485 | 0.732 | 0.731 | 0.864 | 0.804 | 0.151 | 0.254 | |
| OLM12BTemplate Type=minimal2025.04 | 0.445 | 0.445 | 0.593 | 0.432 | 0.678 | 0.691 | 0.819 | 0.727 | 0.145 | 0.242 | |
| ILmXC2Template Type=minimal2025.04 | 0.368 | 0.368 | 0.506 | 0.384 | 0.615 | 0.641 | 0.767 | 0.687 | 0.161 | 0.261 | |
| QVLChatTemplate Type=minimal2025.04 | 0.344 | 0.344 | 0.525 | 0.355 | 0.627 | 0.633 | 0.806 | 0.707 | 0.159 | 0.26 | |
| FuyuTemplate Type=minimal2025.04 | 0.231 | 0.231 | 0.432 | 0.29 | 0.558 | 0.574 | 0.761 | 0.66 | 0.166 | 0.265 | |
| LLAVATemplate Type=minimal2025.04 | 0.182 | 0.182 | 0.259 | 0.195 | 0.417 | 0.5 | 0.513 | 0.445 | 0.151 | 0.225 | |
| OLM3BTemplate Type=minimal2025.04 | 0.14 | 0.14 | 0.319 | 0.193 | 0.462 | 0.508 | 0.648 | 0.538 | 0.144 | 0.227 |