List your company

Personalized Assistant Interaction on LifeSim-Eval Single-Scenario

80.6Explicit Intent RecognitionDeepSeek-V3.2 Thinking
67.28870.74474.277.656Mar 12, 2026

Evaluation results

MethodLinks
DeepSeek-V3.2 ThinkingAccess Type=Open-source2026.0380.659.375.858.284.192.163.474
GPT-5Access Type=Close-source2026.0379.552.276.948.983.997.560.374.6
GPT-4oAccess Type=Close-source2026.037952.672.148.181.49060.574.1
DeepSeek-V3.2Access Type=Open-source2026.0378.654.673.550.885.291.56575.5
Qwen3 14BAccess Type=Open-source2026.037746.368.341.379.186.861.874.7
gpt-oss 20BAccess Type=Open-source2026.0376.943.772.641.183.49157.175.2
Qwen3 32BAccess Type=Open-source2026.0376.651.270.347.483.989.961.775.8
gpt-oss 120BAccess Type=Open-source2026.0376.444.373.342.685.89359.874.2
Claude-Sonnet-4.5Access Type=Close-source2026.0376.149.27346.589.896.960.975.5
Qwen3 8BAccess Type=Open-source2026.0375.744.464.438.47583.360.573.5
Gemma3-it 27BAccess Type=Open-source2026.0372.744.265.439.378.481.361.875.6
Llama3.1-it 70BAccess Type=Open-source2026.0371.741.460.935.579.684.860.473.5
Llama3.1-it 8BAccess Type=Open-source2026.0370.340.358.433.869.372.858.573.8
Gemma3-it 12BAccess Type=Open-source2026.0367.835.8573067.37160.773.5