Utterance Classification on Architecture Deliberation 19 turns Phase 3 (Overall)
85F1 ScoreClaude Sonnet 4
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Claude Sonnet 4Condition=Definitions condition only, Runs=52026.05 | 85 | 63 | |
| GPT-4oCondition=Definitions condition only, Runs=52026.05 | 80 | 65 | |
| Qwen2.5-7B-InstructCondition=Definitions condition only, Runs=52026.05 | 75 | 61 | |
| Llama-3.1-8B-InstructCondition=Definitions condition only, Runs=52026.05 | 66 | 33 |