List your company
ResearchFormerly WizWand

Summarization on eBay Bot Chat

3.52Mean Auto-Rating (r)Gemma3 1B
0.95121.61812.2852.9519Nov 4, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Gemma3 1BVersion=r12025.113.521.555
Llama 3.1 8BVersion=r12025.113.4350.955
Llama 3.1 8BVersion=r22025.113.2650.785
Llama 3.2 3BVersion=r22025.113.221.43
Llama 3.2 3BVersion=r12025.113.21.41
Llama 3.2 1BVersion=r22025.113.1650.975
Qwen3 4BVersion=r22025.113.0650.97
Llama 3.2 1BVersion=r12025.113.030.84
Qwen3 4BVersion=r12025.1130.905
GPT3.5Version=out-of-box2025.112.525—
Llama 3.1 8BVersion=org2025.112.48—
Qwen3 4BVersion=out-of-box2025.112.3450.25
Phi3.5mini 4BVersion=r22025.112.290.375
Phi3.5mini 4BVersion=r12025.112.2850.37
Llama 3.2 1BVersion=org2025.112.19—
Gemma3 270MVersion=r22025.112.130.2
Gemma3 270MVersion=r12025.112.120.19
Qwen3 4BVersion=org2025.112.095—
Gemma3 1BVersion=r22025.112.0650.1
Gemma3 1BVersion=org2025.111.965—
Gemma3 270MVersion=org2025.111.93—
Phi3.5mini 4BVersion=org2025.111.915—
Llama 3.2 3BVersion=org2025.111.79—
Llama 3.1 8BVersion=out-of-box2025.111.63-0.85
Phi3.5mini 4BVersion=out-of-box2025.111.61-0.305
Llama 3.2 1BVersion=out-of-box2025.111.375-0.815
Gemma3 1BVersion=out-of-box2025.111.265-0.7
Llama 3.2 3BVersion=out-of-box2025.111.195-0.595
Gemma3 270MVersion=out-of-box2025.111.05-0.88