Summarization on Overall Multi-dataset Average
48CompletenessJury-on-Demand
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Jury-on-DemandJury Configuration=Jury-on-Demand2025.12 | 48 | 54 | — | |
| Gemini 2.5 FlashModel Variant=Gemini 2.5 Flash2025.12 | 46 | 49 | — | |
| GPT-OSS 120BModel Variant=GPT-OSS 120B2025.12 | 46 | 52 | — | |
| Gemini 2.0 FlashModel Variant=Gemini 2.0 Flash2025.12 | 45 | 49 | — | |
| Gemini 2.5 ProModel Variant=Gemini 2.5 Pro2025.12 | 45 | 51 | — | |
| Claude 3.7Model Variant=Claude 3.72025.12 | 42 | 56 | — | |
| GPT-OSS 20BModel Variant=GPT-OSS 20B2025.12 | 35 | 45 | — | |
| Gemma 3Model Variant=Gemma 32025.12 | 26 | 51 | — | |
| Phi 4Model Variant=Phi 42025.12 | 18 | 24 | — | |
| DeepSeek R1Model Variant=DeepSeek R12025.12 | 17 | 20 | — | |
| LLAMA 3.2Model Variant=LLAMA 3.22025.12 | 12 | 23 | — |