Operating Room Violation Scenario Knowledge Classification on 4D-OR Expert-Authored Challenge Subset
95.86Common Classification ScoreOurs (FT, Ensemble)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Ours (FT, Ensemble)Fine-tuned=true, Variant=Ensemble2025.06 | 95.86 | 95.61 | 100 | 96.8 | |
| Ours (FT, Qwen-Screen)Fine-tuned=true, Variant=Qwen-Screen2025.06 | 91.63 | 95.76 | 99 | 95.37 | |
| GPT-4o-mini2025.06 | 90.67 | 87.77 | 81.54 | 87.03 | |
| Gemini-1.5-Flash2025.06 | 82 | 80.79 | 73.08 | 79.18 | |
| GPT-4o2025.06 | 75.29 | 78.4 | 62.3 | 73.37 | |
| Qwen2.5-VL-7B-Instruct2025.06 | 73.31 | 57.73 | 69.64 | 65.36 | |
| Llama-3.2-11B-Vision-Instruct2025.06 | 63.33 | 75.98 | 63.85 | 69.15 | |
| BaichuanMed-OCR-7B2025.06 | 58.6 | 67.21 | 52.66 | 60.96 | |
| Qwen-vl-plus2025.06 | 57.35 | 75.41 | 52.46 | 64.23 | |
| GLM-4.6V-Flash2025.06 | 34.67 | 31.44 | 34.62 | 33.2 |