Action Prediction on MiCU Dataset
87.21Accuracy (Light)MiCU-4B-fast
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MiCU-4B-fastType=Open Source LLM2026.05 | 87.21 | 90.78 | 88.43 | 85.09 | 90.35 | |
| MiCU-4BType=Open Source LLM2026.05 | 87.03 | 92.01 | 83.24 | 80.49 | 90.33 | |
| Rule-based SelectionType=Rule-based2026.05 | 73 | 30 | 57.02 | 60.87 | 45.53 | |
| GPT-4oType=Proprietary LLM2026.05 | 50.79 | 67.84 | 41.32 | 62.11 | 60.19 | |
| DeepSeek-R1Type=Proprietary LLM2026.05 | 49.89 | 68.04 | 36.36 | 50.93 | 60.6 | |
| DeepSeek-V3.2Type=Proprietary LLM2026.05 | 48.76 | 65.88 | 30.74 | 37.27 | 59.29 | |
| GPT-4o-miniType=Proprietary LLM2026.05 | 45.37 | 55.49 | 31.4 | 50.31 | 49.66 | |
| Qwen3-30BType=Open Source LLM2026.05 | 42.25 | 51.8 | 38.55 | 39.5 | 46.79 | |
| Llama3.3-70BType=Open Source LLM2026.05 | 40.18 | 49.91 | 38.55 | 36.08 | 45.18 | |
| Llama3.1-8BType=Open Source LLM2026.05 | 36.79 | 37.84 | 34.13 | 27.33 | 36.09 | |
| Qwen3-4BType=Open Source LLM2026.05 | 29.57 | 17.84 | 28.93 | 36.65 | 24.21 |