Summarization (Groundedness) on DialSummEval
0.7GroundednessGemini 2.5 Flash
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini 2.5 FlashModel Variant=Gemini 2.5 Flash2025.12 | 0.7 | — | — | |
| Gemini 2.5 ProModel Variant=Gemini 2.5 Pro2025.12 | 0.69 | — | — | |
| Jury-on-DemandJury Configuration=Jury-on-Demand2025.12 | 0.67 | — | — | |
| GPT-OSS 120BModel Variant=GPT-OSS 120B2025.12 | 0.66 | — | — | |
| GPT-OSS 20BModel Variant=GPT-OSS 20B2025.12 | 0.65 | — | — | |
| Gemma 3Model Variant=Gemma 32025.12 | 0.64 | — | — | |
| Gemini 2.0 FlashModel Variant=Gemini 2.0 Flash2025.12 | 0.63 | — | — | |
| Claude 3.7Model Variant=Claude 3.72025.12 | 0.59 | — | — | |
| LLAMA 3.2Model Variant=LLAMA 3.22025.12 | 0.33 | — | — | |
| DeepSeek R1Model Variant=DeepSeek R12025.12 | 0.33 | — | — | |
| Phi 4Model Variant=Phi 42025.12 | 0.24 | — | — | |
| Jury-on-DemandJury Configuration=Dynamic2025.12 | — | 0.67 | 0.05 | |
| Static JuryJury Configuration=Average-All2025.12 | — | 0.66 | 0.02 | |
| Static JuryJury Configuration=Average-TopK2025.12 | — | 0.69 | 0.02 | |
| Static JuryJury Configuration=Weighted-Regression2025.12 | — | 0.68 | 0.02 | |
| Static JuryJury Configuration=Weighted-Tau2025.12 | — | 0.68 | 0.02 |