Seizure Semiology Classification (Task 3) on Seizure Semiology Suite (S3)
25Head Turning PrecisionQwen2.5-VL-32B
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-VL-32BParameters=32B, Category=Vision-LLM2026.05 | 25 | 43 | 32 | 59 | 78 | 29 | 42 | 30 | 34 | 28 | 25 | 37 | |
| Qwen3-VL-32BParameters=32B, Category=Vision-LLM2026.05 | 24 | 86 | 38 | 38 | 87 | 54 | 67 | 52 | 18 | 26 | 15 | 20 | |
| Qwen2.5-VL-7BParameters=7B, Category=Vision-LLM2026.05 | 23 | 100 | 37 | 25 | 60 | 12 | 21 | 15 | 19 | 28 | 21 | 28 | |
| InternVL3.5-8BParameters=8B, Category=Vision-LLM2026.05 | 22 | 100 | 36 | 22 | 88 | 88 | 88 | 78 | 9 | 12 | 8 | 14 | |
| InternVL3.5-38BParameters=38B, Category=Vision-LLM2026.05 | 22 | 100 | 36 | 22 | 88 | 92 | 90 | 81 | 2 | 8 | 2 | 7 | |
| Lingshu-32BParameters=32B, Category=Medical-VLM2026.05 | 22 | 100 | 36 | 22 | 94 | 67 | 78 | 67 | 15 | 19 | 17 | 40 | |
| Qwen2.5-VL-72BParameters=72B, Category=Vision-LLM2026.05 | 17 | 14 | 15 | 66 | 100 | 71 | 83 | 74 | 23 | 21 | 18 | 36 | |
| Qwen2.5-Omni-7BParameters=7B, Category=Omni-LLM2026.05 | 15 | 29 | 20 | 50 | 50 | 8 | 14 | 11 | 10 | 14 | 5 | 8 | |
| Qwen3-VL-8BParameters=8B, Category=Vision-LLM2026.05 | 14 | 14 | 14 | 62 | 50 | 4 | 8 | 11 | 8 | 9 | 6 | 16 | |
| Qwen3-Omni-30BParameters=30B, Category=Omni-LLM2026.05 | 0 | 0 | 0 | 75 | 50 | 8 | 14 | 11 | 15 | 18 | 14 | 22 | |
| seizure_omni_sft-7BParameters=7B, Category=SeizureMLLMs2026.05 | 0 | 0 | 0 | 78 | 0 | 0 | 0 | 11 | 8 | 14 | 10 | 43 | |
| seizure_omni_grpo-7BParameters=7B, Category=SeizureMLLMs2026.05 | 0 | 0 | 0 | 78 | 0 | 0 | 0 | 11 | 18 | 14 | 11 | 43 |