Image Based QA on MM-Telco
13sacreBLEUJanus-Pro-7B
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Janus-Pro-7B2025.11 | 13 | 32 | 38 | 25 | 84 | |
| Llama-3.2-11B-Vision-Instruct2025.11 | 9 | 6 | 34 | 21 | 89 | |
| Qwen2.5-VL-7B-Instruct2025.11 | 8 | 29 | 36 | 21 | 89 |
Loading the SOTA2 catalog…
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Janus-Pro-7B2025.11 | 13 | 32 | 38 | 25 | 84 | |
| Llama-3.2-11B-Vision-Instruct2025.11 | 9 | 6 | 34 | 21 | 89 | |
| Qwen2.5-VL-7B-Instruct2025.11 | 8 | 29 | 36 | 21 | 89 |