Image Tagging on Objects365
67.59OPTagLLM
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TagLLMBase Model=Qwen3-VL-30B-A3B-Instruct, GPU Time=2422026.02 | 67.59 | 67.91 | 67.75 | 54.99 | 67.07 | 60.43 | |
| RAM++GPU Time=< 12026.02 | 66.11 | 23.54 | 34.72 | 54.71 | 31.25 | 39.78 | |
| CaSEDGPU Time=32026.02 | 63.84 | 6.41 | 11.65 | 48.02 | 11.12 | 18.05 | |
| TagLLMBase Model=Qwen3-VL-8B-Instruct, GPU Time=662026.02 | 63.38 | 70.83 | 66.9 | 53.48 | 65.57 | 58.91 | |
| BPBase Model=Qwen3-VL-30B-A3B-Instruct, GPU Time=27802026.02 | 53.64 | 73.53 | 62.03 | 42.15 | 73.9 | 53.68 | |
| TagCLIPGPU Time=92026.02 | 51.71 | 50.53 | 51.11 | 38.01 | 31.99 | 34.74 | |
| BPBase Model=Qwen3-VL-8B-Instruct, GPU Time=6502026.02 | 45.57 | 79.63 | 57.97 | 37.02 | 75.67 | 49.71 | |
| MOPBase Model=Qwen3-VL-30B-A3B-Instruct, GPU Time=922026.02 | 39.98 | 84.28 | 54.23 | 32.04 | 82.64 | 46.18 | |
| CLIPGPU Time=< 12026.02 | 39.6 | 40.87 | 40.22 | 31.9 | 29.94 | 30.89 | |
| MOPBase Model=Qwen3-VL-8B-Instruct, GPU Time=302026.02 | 39.5 | 85.38 | 54.01 | 32.98 | 79.42 | 46.61 | |
| NXTPGPU Time=42026.02 | 34.71 | 25.11 | 29.14 | 41.72 | 18.52 | 25.65 |