Utterance Classification on Architecture Deliberation Key shifts (4 turns) Phase 3
92F1 ScoreClaude Sonnet 4
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Claude Sonnet 4Condition=Definitions condition only, Runs=52026.05 | 92 | 75 | |
| Qwen2.5-7B-InstructCondition=Definitions condition only, Runs=52026.05 | 92 | 75 | |
| GPT-4oCondition=Definitions condition only, Runs=52026.05 | 83 | 50 | |
| Llama-3.1-8B-InstructCondition=Definitions condition only, Runs=52026.05 | 59 | 20 |