Deliberation Summarization on DELIBERATIONBANK
0.622Overall Quality ScoreGPT-5-Mini
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-5-Mini2025.10 | 0.622 | — | — | — | — | |
| GPT-52025.10 | 0.617 | — | — | — | — | |
| Claude-Sonnet-42025.10 | 0.615 | — | — | — | — | |
| Claude-Opus-42025.10 | 0.614 | — | — | — | — | |
| Qwen3-32B2025.10 | 0.609 | — | — | — | — | |
| Gemini-2.5-Flash2025.10 | 0.605 | — | — | — | — | |
| Grok-42025.10 | 0.594 | — | — | — | — | |
| Gemini-2.5-Pro2025.10 | 0.594 | — | — | — | — | |
| Qwen3-235B2025.10 | 0.593 | — | — | — | — | |
| Qwen3-14B2025.10 | 0.584 | — | — | — | — | |
| Qwen3-1.7B2025.10 | 0.583 | — | — | — | — | |
| DeepSeek-Reasoner2025.10 | 0.58 | — | — | — | — | |
| DeepSeek-Chat2025.10 | 0.576 | — | — | — | — | |
| Qwen3-4B2025.10 | 0.575 | — | — | — | — | |
| Qwen3-8B2025.10 | 0.575 | — | — | — | — | |
| GPT-4o-Mini2025.10 | 0.571 | — | — | — | — | |
| Qwen3-30B2025.10 | 0.571 | — | — | — | — | |
| Qwen3-0.6B2025.10 | 0.55 | — | — | — | — | |
| CoTModel=Llama-3.3-70B2026.04 | — | 0.568 | 0.524 | 0.57 | 0.561 | |
| CoTModel=GPT-4.1-mini2026.04 | — | 0.581 | 0.525 | 0.568 | 0.571 | |
| CoTModel=GPT-4.12026.04 | — | 0.582 | 0.537 | 0.572 | 0.577 | |
| DirectModel=Llama-3.3-70B2026.04 | — | 0.586 | 0.537 | 0.58 | 0.574 | |
| DirectModel=GPT-4.1-mini2026.04 | — | 0.582 | 0.534 | 0.576 | 0.579 | |
| DirectModel=GPT-4.12026.04 | — | 0.578 | 0.531 | 0.573 | 0.575 | |
| MADModel=Llama-3.3-70B2026.04 | — | 0.588 | 0.544 | 0.572 | 0.579 | |
| MADModel=GPT-4.1-mini2026.04 | — | 0.598 | 0.553 | 0.569 | 0.592 | |
| MADModel=GPT-4.12026.04 | — | 0.599 | 0.561 | 0.576 | 0.594 | |
| Self-RefineModel=Llama-3.3-70B2026.04 | — | 0.577 | 0.536 | 0.566 | 0.57 | |
| Self-RefineModel=GPT-4.1-mini2026.04 | — | 0.608 | 0.544 | 0.571 | 0.593 | |
| Self-RefineModel=GPT-4.12026.04 | — | 0.595 | 0.556 | 0.574 | 0.594 | |
| TeamFusionModel=Llama-3.3-70B2026.04 | — | 0.608 | 0.588 | 0.587 | 0.602 | |
| TeamFusionModel=GPT-4.1-mini2026.04 | — | 0.614 | 0.594 | 0.585 | 0.608 | |
| TeamFusionModel=GPT-4.12026.04 | — | 0.621 | 0.622 | 0.582 | 0.619 |