Traffic Sign Structure Parsing on TrafficSignEval
83.87DirectionSignReasoner
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SignReasonerBase Model=Pangu-MM-7B, Performance Protocol=Caption-FSU Distillation2026.04 | 83.87 | 85.71 | 83.21 | 84.21 | 83.59 | |
| SignReasonerBase Model=Pangu-MM-7B, Performance Protocol=FSU-GRPO Training2026.04 | 80.65 | 80 | 84.73 | 88.89 | 84.1 | |
| SignReasonerBase Model=Qwen2.5-VL-7B, Performance Protocol=Caption-FSU Distillation2026.04 | 74.19 | 66.67 | 85.5 | 94.44 | 83.08 | |
| SignReasonerBase Model=Qwen2.5-VL-7B, Performance Protocol=FSU-GRPO Training2026.04 | 74.19 | 73.33 | 86.26 | 94.44 | 84.1 | |
| InternVL3-78BPerformance Protocol=Zero-Shot2026.04 | 68.57 | 63.64 | 61.29 | 71.43 | 63.59 | |
| InternVL3-8BPerformance Protocol=Zero-Shot2026.04 | 51.43 | 63.64 | 54.84 | 57.14 | 55.38 | |
| Pangu-MM-7BPerformance Protocol=Zero-Shot2026.04 | 41.18 | 33.33 | 46.6 | 35.71 | 43.02 | |
| Pangu-MM-7BPerformance Protocol=Caption SFT2026.04 | 41.18 | 33.33 | 46.6 | 35.71 | 43.02 | |
| Qwen2.5-VL-72BPerformance Protocol=Zero-Shot2026.04 | 40 | 68.18 | 50.81 | 71.43 | 52.31 | |
| Qwen2.5-VL-7BPerformance Protocol=Zero-Shot2026.04 | 28.57 | 45.45 | 36.29 | 64.29 | 37.95 | |
| Qwen2.5-VL-7BPerformance Protocol=Caption SFT2026.04 | 28.57 | 45.45 | 36.29 | 64.29 | 37.95 |