Traffic Sign Captioning on TrafficSignEval
80.01DirectionSignReasoner
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SignReasonerBase Model=Pangu-MM-7B, Performance Protocol=FSU-GRPO Training2026.04 | 80.01 | 67.76 | 83.98 | 64.9 | 79.98 | |
| SignReasonerBase Model=Pangu-MM-7B, Performance Protocol=Caption-FSU Distillation2026.04 | 79.41 | 66.67 | 83.5 | 64.29 | 79.07 | |
| SignReasonerBase Model=Qwen2.5-VL-7B, Performance Protocol=FSU-GRPO Training2026.04 | 71 | 67.31 | 76.9 | 57.67 | 73.24 | |
| Pangu-MM-7BPerformance Protocol=Caption SFT2026.04 | 70.59 | 61.9 | 71.84 | 78.57 | 70.93 | |
| SignReasonerBase Model=Qwen2.5-VL-7B, Performance Protocol=Caption-FSU Distillation2026.04 | 70.59 | 66.67 | 76.7 | 57.14 | 72.67 | |
| Qwen2.5-VL-72BPerformance Protocol=Zero-Shot2026.04 | 64.71 | 71.43 | 63.11 | 71.43 | 65.12 | |
| Qwen2.5-VL-7BPerformance Protocol=Caption SFT2026.04 | 58.82 | 61.9 | 56.31 | 64.29 | 58.14 | |
| InternVL3-8BPerformance Protocol=Zero-Shot2026.04 | 55.88 | 57.14 | 53.4 | 50 | 54.07 | |
| InternVL3-78BPerformance Protocol=Zero-Shot2026.04 | 55.88 | 61.9 | 74.76 | 57.14 | 68.02 | |
| Pangu-MM-7BPerformance Protocol=Zero-Shot2026.04 | 55.88 | 52.38 | 53.4 | 57.14 | 54.07 | |
| Qwen2.5-VL-7BPerformance Protocol=Zero-Shot2026.04 | 47.06 | 66.67 | 42.72 | 64.29 | 48.26 |