PST Strategy Annotation (evaluation)
78Avg Weighted F1 (Facilitators)GPT-4o
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4oContext=No context2025.01 | 78 | 81 | 76 | |
| Llama-3.1Context=No context2025.01 | 66 | 70 | 61 | |
| GPT-4Context=No context2025.01 | 65 | 76 | 68 | |
| GPT-4Context=With context2025.01 | 65 | 70 | 64 | |
| Yi-1.5Context=No context2025.01 | 64 | 59 | 56 | |
| GPT-4oContext=With context2025.01 | 59 | 76 | 66 | |
| Yi-1.5Context=With context2025.01 | 56 | 54 | 49 | |
| Llama-3.1Context=With context2025.01 | 55 | 65 | 50 |