Structural language and speech assessment on DementiaBank manual transcripts
1.84Control Group MeanLLaMA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LLaMAModel Version=Llama 3 70B, Transcript type=Manual2026.06 | 1.84 | 2.23 | 0.21 | 0.34 | 0.25 | 0.19 | 0.44 | |
| 4o-miniModel Version=GPT-4o-mini, Transcript type=Manual2026.06 | 1.71 | 2.01 | 0.18 | 0.53 | 0.44 | 0.36 | 0.13 | |
| ClaudeModel Version=Claude 3.5 Sonnet, Transcript type=Manual2026.06 | 1.11 | 1.96 | 0.76 | 0.95 | 0.62 | 0.5 | 0.34 | |
| 4oModel Version=GPT-4o, Transcript type=Manual2026.06 | 1.08 | 1.8 | 0.67 | 0.95 | 0.6 | 0.46 | 0.31 |