Smart home command understanding on DevCmd all device categories
94.61AccuracyMiCU
Evaluation Results
| Method | Links | |
|---|---|---|
| MiCUParameter=4B2026.05 | 94.61 | |
| DeepSeek-R1Parameter=671B2026.05 | 73.1 | |
| RSParameter=N.A.2026.05 | 66.32 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| MiCUParameter=4B2026.05 | 94.61 | |
| DeepSeek-R1Parameter=671B2026.05 | 73.1 | |
| RSParameter=N.A.2026.05 | 66.32 |