Depression Detection on eRisk (test)
0.78F1 ScorePHQ9 (vectors)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PHQ9 (vectors)Prompt/Train source=TRT2022.04 | 0.78 | — | |
| PHQ9PlusTrain=eRisk, Number of posts=4002022.04 | 0.73 | 0.94 | |
| PHQ9 (scores)Prompt/Train source=TRT2022.04 | 0.72 | — | |
| Unconstrained (BERT)Train=eRisk, Number of posts=all2022.04 | 0.71 | 0.95 | |
| PHQ9 (vectors)Prompt/Train source=RSDD2022.04 | 0.64 | — | |
| PHQ9 (scores)Prompt/Train source=RSDD2022.04 | 0.62 | — | |
| PHQ9 (vectors)Train=eRisk, Number of posts=4002022.04 | 0.55 | 0.88 | |
| PHQ9 (scores)Train=eRisk, Number of posts=4002022.04 | 0.54 | 0.87 | |
| GPT-3Prompt/Train source=TRT, Few-shot=4 examples per class2022.04 | 0.54 | — | |
| GPT-3Prompt/Train source=RSDD, Few-shot=4 examples per class2022.04 | 0.52 | — | |
| PHQ9PlusTrain=RSDD, Number of posts=4002022.04 | 0.49 | 0.81 | |
| Pattern (CNN)Train=RSDD, Number of posts=4002022.04 | 0.47 | 0.79 | |
| PHQ9 (vectors)Train=RSDD, Number of posts=4002022.04 | 0.46 | 0.81 | |
| Unconstrained (BERT)Train=RSDD, Number of posts=all2022.04 | 0.44 | 0.84 | |
| PHQ9 (scores)Train=RSDD, Number of posts=4002022.04 | 0.43 | 0.8 | |
| Pattern (CNN)Train=eRisk, Number of posts=4002022.04 | 0.43 | 0.8 | |
| PHQ9 (scores)Train=TRT, Number of posts=4002022.04 | 0.41 | 0.85 | |
| Pattern (CNN)Train=TRT, Number of posts=4002022.04 | 0.4 | 0.79 | |
| PHQ9PlusTrain=TRT, Number of posts=4002022.04 | 0.4 | 0.8 | |
| Pattern (threshold)Train=eRisk, Number of posts=4002022.04 | 0.4 | — | |
| Pattern (threshold)Train=TRT, Number of posts=4002022.04 | 0.38 | — | |
| Pattern (threshold)Train=RSDD, Number of posts=4002022.04 | 0.38 | — | |
| PHQ9 (vectors)Train=TRT, Number of posts=4002022.04 | 0.31 | 0.86 | |
| Unconstrained (BERT)Train=TRT, Number of posts=all2022.04 | 0.15 | 0.84 |