Response and Tool-Call Quality Evaluation on E-commerce Assistant Evaluation Set (Offline)
61.4TCRManualSkill
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ManualSkillAdded Component=Human-designed skill baseline2026.06 | 61.4 | 56.1 | 70.9 | 65.3 | 64.9 | |
| SkillChain (Full)Added Component=+ Dual-path evaluation & Body refinement2026.06 | 61.3 | 72.2 | 82.3 | 62.7 | 72.2 | |
| SkillChainS1+S2Added Component=+ Routing failure mining & Description update2026.06 | 55.3 | 63.4 | 76.5 | 54.1 | 67.2 | |
| NoSkillAdded Component=Production baseline (no Skill constraint)2026.06 | 54.4 | 49.1 | 69.6 | 52.8 | 59.1 | |
| SkillChainS1Added Component=Auto Skill creation + human reflection2026.06 | 46.7 | 58.9 | 76.6 | 53.7 | 62.5 |