General cognition and perception assessment on DementiaBank manual transcripts
1.93Mean (Control Group)4o-mini
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| 4o-miniModel Version=GPT-4o-mini, Transcript type=Manual2026.06 | 1.93 | 2.1 | 0.09 | 0.36 | 0.37 | 0.1 | 0.1 | |
| LLaMAModel Version=Llama 3 70B, Transcript type=Manual2026.06 | 1.81 | 2.17 | 0.2 | 0.3 | 0.2 | 0.06 | 0.55 | |
| 4oModel Version=GPT-4o, Transcript type=Manual2026.06 | 1.39 | 2.08 | 0.49 | 0.65 | 0.53 | 0.52 | 0.36 | |
| ClaudeModel Version=Claude 3.5 Sonnet, Transcript type=Manual2026.06 | 0.94 | 1.96 | 1.09 | 1.04 | 0.61 | 0.53 | 0.45 |