Sketch-to-Feedback Evaluation on Circuit-10 (test)
32.9Mi-F1Sketch2Feedback (Grammar)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Sketch2Feedback (Grammar)Backbone=Qwen2-VL-2B, Approach=Grammar+VLM2026.02 | 32.9 | 52.2 | 24 | 2.95 | 5 | 92.5 | 8.9 | |
| E2E-LMMBackbone=LLaVA-1.5-7B, Approach=End-to-End2026.02 | 3.8 | 33.3 | 2 | 3.81 | 4.03 | 75 | 3.7 | |
| Vision-onlyApproach=Static template feedback, Constraint Checking=None2026.02 | 0 | 0 | 0 | 1.7 | 2.2 | 20 | — |