Mental Health Question Answering on MHQA Gold (test)
41.22Anxiety ScoreFull (our)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Full (our)Backbone=LLaMA-3.2-1B-Instruct, Training Mode=Full fine-tuned2025.07 | 41.22 | 43.11 | 50.89 | 42.38 | 44.4 | |
| QAT-LoRA (our)Backbone=LLaMA-3.2-1B-Instruct, Training Mode=Quantized fine-tuned (QAT-LoRA), Nickname=EmoSApp2025.07 | 39.07 | 40.19 | 42.78 | 35.32 | 39.34 | |
| BioBERT2025.07 | 36.79 | 28.99 | 34.92 | 31.33 | 33 | |
| BERT-base2025.07 | 32.55 | 29.53 | 32.72 | 26.65 | 30.35 | |
| LoRA+PTQ (our)Backbone=LLaMA-3.2-1B-Instruct, Training Mode=Quantized fine-tuned (LoRA+PTQ)2025.07 | 30.63 | 33.87 | 38.57 | 30.41 | 33.37 | |
| RoBERTa2025.07 | 29.47 | 31.6 | 27.71 | 28.25 | 29.25 | |
| Mental-RoBERTa2025.07 | 24.66 | 26.74 | 24.47 | 20.72 | 24.12 | |
| MentalBERT2025.07 | 22.98 | 26.44 | 26.39 | 22.36 | 24.55 | |
| PubMedBERT2025.07 | 22.16 | 25.5 | 20.82 | 24.44 | 23.22 |