# Traffic Sign Structure Parsing on TrafficSignEval Source: [Traffic Sign Structure Parsing on TrafficSignEval]() Collection index: [llms.txt]() Data updated: 2026-04-14T09:11:06.333Z Evaluation of Traffic Sign Structure Parsing performance on the TrafficSignEval dataset, reporting component-wise metrics such as Direction, Notice, Lane, and Const. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Traffic Sign Structure Parsing | | Dataset (including any stated split) | TrafficSignEval | | Metric | Direction | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Direction](): Higher is better; unit: PERCENT. - [Notice](): Higher is better; unit: PERCENT. - [Lane](): Higher is better; unit: PERCENT. - [Const.](): Higher is better; unit: PERCENT. - [Average Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Direction | Result date | Report paper | | --- | --- | --- | --- | | SignReasoner | 83.87 | Not recorded | 69ddca3e7d0172140ec79c1d | | SignReasoner | 80.65 | Not recorded | 69ddca3e7d0172140ec79c1d | | SignReasoner | 74.19 | Not recorded | 69ddca3e7d0172140ec79c1d | | SignReasoner | 74.19 | Not recorded | 69ddca3e7d0172140ec79c1d | | InternVL3-78B | 68.57 | Not recorded | 69ddca3e7d0172140ec79c1d | | InternVL3-8B | 51.43 | Not recorded | 69ddca3e7d0172140ec79c1d | | Pangu-MM-7B | 41.18 | Not recorded | 69ddca3e7d0172140ec79c1d | | Pangu-MM-7B | 41.18 | Not recorded | 69ddca3e7d0172140ec79c1d | | Qwen2.5-VL-72B | 40 | Not recorded | 69ddca3e7d0172140ec79c1d | | Qwen2.5-VL-7B | 28.57 | Not recorded | 69ddca3e7d0172140ec79c1d | | Qwen2.5-VL-7B | 28.57 | Not recorded | 69ddca3e7d0172140ec79c1d | ### SignReasoner Direction: 83.87. Result ID: 69de049647f34ce924c5a3a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Pangu-MM-7B","Performance Protocol":"Caption-FSU Distillation"}. This record does not assert independent reproduction. ### SignReasoner Direction: 80.65. Result ID: 69de049647f34ce924c5a3a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Pangu-MM-7B","Performance Protocol":"FSU-GRPO Training"}. This record does not assert independent reproduction. ### SignReasoner Direction: 74.19. Result ID: 69de049647f34ce924c5a3a3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-VL-7B","Performance Protocol":"Caption-FSU Distillation"}. This record does not assert independent reproduction. ### SignReasoner Direction: 74.19. Result ID: 69de049647f34ce924c5a3a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-VL-7B","Performance Protocol":"FSU-GRPO Training"}. This record does not assert independent reproduction. ### InternVL3-78B Direction: 68.57. Result ID: 69de049647f34ce924c5a39d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Performance Protocol":"Zero-Shot"}. This record does not assert independent reproduction. ### InternVL3-8B Direction: 51.43. Result ID: 69de049647f34ce924c5a39c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Performance Protocol":"Zero-Shot"}. This record does not assert independent reproduction. ### Pangu-MM-7B Direction: 41.18. Result ID: 69de049647f34ce924c5a3a0. [Reporting paper]() Recorded evaluation configuration: {"Performance Protocol":"Zero-Shot"}. This record does not assert independent reproduction. ### Pangu-MM-7B Direction: 41.18. Result ID: 69de049647f34ce924c5a3a2. [Reporting paper]() Recorded evaluation configuration: {"Performance Protocol":"Caption SFT"}. This record does not assert independent reproduction. ### Qwen2.5-VL-72B Direction: 40. Result ID: 69de049647f34ce924c5a39f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Performance Protocol":"Zero-Shot"}. This record does not assert independent reproduction. ### Qwen2.5-VL-7B Direction: 28.57. Result ID: 69de049647f34ce924c5a39e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Performance Protocol":"Zero-Shot"}. This record does not assert independent reproduction. ### Qwen2.5-VL-7B Direction: 28.57. Result ID: 69de049647f34ce924c5a3a1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Performance Protocol":"Caption SFT"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.