Summarization on eBay Bot Chat
3.52Mean Auto-Rating (r)Gemma3 1B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Gemma3 1BVersion=r12025.11 | 3.52 | 1.555 | |
| Llama 3.1 8BVersion=r12025.11 | 3.435 | 0.955 | |
| Llama 3.1 8BVersion=r22025.11 | 3.265 | 0.785 | |
| Llama 3.2 3BVersion=r22025.11 | 3.22 | 1.43 | |
| Llama 3.2 3BVersion=r12025.11 | 3.2 | 1.41 | |
| Llama 3.2 1BVersion=r22025.11 | 3.165 | 0.975 | |
| Qwen3 4BVersion=r22025.11 | 3.065 | 0.97 | |
| Llama 3.2 1BVersion=r12025.11 | 3.03 | 0.84 | |
| Qwen3 4BVersion=r12025.11 | 3 | 0.905 | |
| GPT3.5Version=out-of-box2025.11 | 2.525 | — | |
| Llama 3.1 8BVersion=org2025.11 | 2.48 | — | |
| Qwen3 4BVersion=out-of-box2025.11 | 2.345 | 0.25 | |
| Phi3.5mini 4BVersion=r22025.11 | 2.29 | 0.375 | |
| Phi3.5mini 4BVersion=r12025.11 | 2.285 | 0.37 | |
| Llama 3.2 1BVersion=org2025.11 | 2.19 | — | |
| Gemma3 270MVersion=r22025.11 | 2.13 | 0.2 | |
| Gemma3 270MVersion=r12025.11 | 2.12 | 0.19 | |
| Qwen3 4BVersion=org2025.11 | 2.095 | — | |
| Gemma3 1BVersion=r22025.11 | 2.065 | 0.1 | |
| Gemma3 1BVersion=org2025.11 | 1.965 | — | |
| Gemma3 270MVersion=org2025.11 | 1.93 | — | |
| Phi3.5mini 4BVersion=org2025.11 | 1.915 | — | |
| Llama 3.2 3BVersion=org2025.11 | 1.79 | — | |
| Llama 3.1 8BVersion=out-of-box2025.11 | 1.63 | -0.85 | |
| Phi3.5mini 4BVersion=out-of-box2025.11 | 1.61 | -0.305 | |
| Llama 3.2 1BVersion=out-of-box2025.11 | 1.375 | -0.815 | |
| Gemma3 1BVersion=out-of-box2025.11 | 1.265 | -0.7 | |
| Llama 3.2 3BVersion=out-of-box2025.11 | 1.195 | -0.595 | |
| Gemma3 270MVersion=out-of-box2025.11 | 1.05 | -0.88 |