Proactive Assistance on Household domain
19.1SpeedupMindZero w/ Qwen3-4B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MindZero w/ Qwen3-4BBackbone=Qwen3-4B2026.05 | 19.1 | 201.2 | |
| Gemini-3-FlashCategory=Large Model2026.05 | 17.7 | — | |
| MindZero w/ Llama-3.1-8BBackbone=Llama-3.1-8B2026.05 | 17.4 | 608.4 | |
| Qwen3-235B-A22BCategory=Large Model2026.05 | 12.3 | 1,101.6 | |
| GPT-5.2Category=Large Model2026.05 | 9.4 | — | |
| MindZero w/ Llama-3.2-3B*Backbone=Llama-3.2-3B, requires fine-tuning=true2026.05 | 4.3 | 235.1 | |
| Llama-3.2-3B*Category=Base Model, requires fine-tuning=true2026.05 | 2.3 | 244.3 | |
| Qwen3-4BCategory=Base Model2026.05 | 2.3 | 213.1 | |
| Llama-3.1-8BCategory=Base Model2026.05 | 1.7 | 656.1 | |
| Random Goal2026.05 | -2.2 | — |