List your company

Smart Home Agent Interaction on SmartHome-Bench

96.22Quality Task 1 (QT1)HomeFlow-RL
24.959243.459661.9680.4604May 31, 2026

Evaluation results

MethodLinks
HomeFlow-RLModel Size=4B2026.0596.2272.2288.1792.8376.8484.62.0689.07
HomeFlow-SFTModel Size=4B2026.0594.9964.789.586.7576.881.52.0690.48
HomeFlow-SFTModel Size=8B2026.0594.9973.8990.6885.7181.0582.452.01113.88
HomeFlow-RLModel Size=8B2026.0594.7279.6390.6888.3182.1187.032.0789.11
DeepSeek-V4-Flash2026.0593.1478.1584.5987.7984.2185.162.526.98
Role-playModel Size=8B2026.0591.5660.1984.9585.4570.5377.781.97119.65
GLM-52026.0591.0374.0790.6887.2787.3784.42.3286.06
Role-playModel Size=4B2026.0589.7155.5682.0885.4574.7475.621.96119.01
Qwen-3.5 Plus2026.0589.4573.8988.5389.8785.2684.152.1784.03
Claude-4.6-Sonnet2026.0588.6579.2688.5383.981.0584.092.1698.09
MiniMax M2.72026.0573.8855.5661.6581.381.0568.062.177.9
GPT-5.52026.0572.8290.1994.2788.0578.9585.82.1361.16
Qwen3Model Size=4B2026.05389.4413.6265.4553.6830.851.5168.43
Qwen3Model Size=8B2026.0527.710.1913.2668.836031.871.4364.32