Object and Attribute Inference on CoBSAT 2-shot 1.0
0.927Color Inference (Phase I)TBDN (I3)
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TBDN (I3)LVLM Backbone=InternVL3-8B, Visual Generator=FLUX.1-dev2026.01 | 0.927 | 0.808 | 0.383 | 0.808 | 0.52 | 0.587 | 0.956 | 0.486 | 0.789 | 0.568 | 0.683 | |
| TBDN (Q2)LVLM Backbone=Qwen2-VL-7B-Instruct, Visual Generator=FLUX.1-dev2026.01 | 0.909 | 0.879 | 0.5 | 0.76 | 0.556 | 0.724 | 0.905 | 0.487 | 0.683 | 0.531 | 0.693 | |
| SX-IGCLVLM Backbone=SEED-X, ImageGen-CoT Fine-tuning=true2026.01 | 0.884 | 0.692 | 0.928 | 0.936 | 0.42 | 0.504 | 0.612 | 0.66 | 0.524 | 0.424 | 0.658 | |
| TBDN (Q2.5)LVLM Backbone=Qwen2.5-VL-7B-Instruct, Visual Generator=FLUX.1-dev2026.01 | 0.843 | 0.594 | 0.347 | 0.624 | 0.459 | 0.534 | 0.794 | 0.409 | 0.589 | 0.441 | 0.563 | |
| Base (I3)LVLM Backbone=InternVL3-8B, Visual Generator=FLUX.1-dev2026.01 | 0.826 | 0.76 | 0.317 | 0.711 | 0.432 | 0.385 | 0.866 | 0.442 | 0.701 | 0.429 | 0.586 | |
| SXLVLM Backbone=SEED-X2026.01 | 0.796 | 0.412 | 0.316 | 0.596 | 0.24 | 0.176 | 0.344 | 0.26 | 0.252 | 0.104 | 0.349 | |
| Base (Q2)LVLM Backbone=Qwen2-VL-7B-Instruct, Visual Generator=FLUX.1-dev2026.01 | 0.766 | 0.719 | 0.299 | 0.498 | 0.426 | 0.501 | 0.769 | 0.338 | 0.686 | 0.366 | 0.536 | |
| ThinkDiff2026.01 | 0.622 | 0.349 | 0.237 | 0.459 | 0.29 | 0.511 | 0.534 | 0.34 | 0.534 | 0.292 | 0.417 | |
| SL-IGCLVLM Backbone=SEED-LLaMA, ImageGen-CoT Fine-tuning=true2026.01 | 0.62 | 0.368 | 0.384 | 0.424 | 0.06 | 0.192 | 0.288 | 0.208 | 0.216 | 0.148 | 0.291 | |
| SLLVLM Backbone=SEED-LLaMA2026.01 | 0.616 | 0.216 | 0.272 | 0.592 | 0.112 | 0.088 | 0.168 | 0.192 | 0.22 | 0.056 | 0.254 | |
| Base (Q2.5)LVLM Backbone=Qwen2.5-VL-7B-Instruct, Visual Generator=FLUX.1-dev2026.01 | 0.354 | 0.407 | 0.127 | 0.392 | 0.223 | 0.231 | 0.442 | 0.213 | 0.522 | 0.217 | 0.312 | |
| GILL2026.01 | 0.171 | 0.054 | 0.069 | 0.063 | 0.074 | 0.01 | 0.043 | 0.024 | 0.022 | 0.04 | 0.057 | |
| Emu12026.01 | 0.065 | 0.051 | 0.057 | 0.052 | 0.078 | 0.062 | 0.109 | 0.081 | 0.092 | 0.074 | 0.072 |