Psychiatric symptom identification on PsySym (official split)
79.8Macro RecallSynSym with Real
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SynSym with RealBackbone=MentalBERT, Training Data=Synthetic + Real (fine-tuned)2026.03 | 79.8 | 83 | |
| GPT4o-COTPrompting Strategy=Chain-of-Thought, Evaluation Protocol=Zero-shot2026.03 | 77.5 | 80.7 | |
| GPT4o-ZSLPrompting Strategy=Direct multi-label classification, Evaluation Protocol=Zero-shot2026.03 | 77.4 | 80.8 | |
| GPT4o-PSPrompting Strategy=Plan-and-solve, Evaluation Protocol=Zero-shot2026.03 | 75.5 | 80.8 | |
| DeBERTaTraining Data=Real, Evaluation Protocol=Fine-tuned2026.03 | 74.7 | 79.6 | |
| BERTTraining Data=Real, Evaluation Protocol=Fine-tuned2026.03 | 73.8 | 81.4 | |
| SynSym w/o RealBackbone=MentalBERT, Training Data=Synthetic solely2026.03 | 73.2 | 77.8 | |
| MentalBERTTraining Data=Real, Evaluation Protocol=Fine-tuned2026.03 | 73 | 81.1 |