Device Identification on MiCU Dataset
89.81Accuracy (Light)MiCU-4B
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MiCU-4BType=Open Source LLM2026.05 | 89.81 | 94.51 | 92.27 | 93.25 | 96.8 | |
| MiCU-4B-fastType=Open Source LLM2026.05 | 88.22 | 94.51 | 91.75 | 94.44 | 95.89 | |
| DeepSeek-V3.2Type=Proprietary LLM2026.05 | 76.65 | 77.66 | 74.23 | 51.19 | 82.46 | |
| DeepSeek-R1Type=Proprietary LLM2026.05 | 72.58 | 60.17 | 65.09 | 46.67 | 79.51 | |
| GPT-4oType=Proprietary LLM2026.05 | 66.99 | 57.51 | 62.37 | 40.08 | 80.43 | |
| Rule-based SelectionType=Rule-based2026.05 | 61.37 | 72.52 | 74.19 | 71.92 | 76.98 | |
| Qwen3-30BType=Open Source LLM2026.05 | 51.52 | 42.18 | 49.25 | 29.99 | 72.85 | |
| Llama3.3-70BType=Open Source LLM2026.05 | 45.99 | 43.25 | 45.18 | 29.9 | 70.03 | |
| Llama3.1-8BType=Open Source LLM2026.05 | 41.95 | 38.97 | 39.66 | 23.17 | 63.65 | |
| GPT-4o-miniType=Proprietary LLM2026.05 | 33.97 | 52.01 | 51.55 | 34.13 | 71.04 | |
| Qwen3-4BType=Open Source LLM2026.05 | 31.19 | 10.6 | 28.88 | 13.65 | 39.19 |