Psychological Defense Detection on PsyDefDetect (test)
64.71AccuracyMinistral-8B (Local)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Ministral-8B (Local)Paradigm=LLM Fine-Tuning (LoRA)2026.05 | 64.71 | — | — | — | — | — | — | 14.74 | |
| Qwen3-8BParadigm=LLM Fine-Tuning (LoRA)2026.05 | 64.19 | — | — | — | — | 40.03 | 39.58 | 39.17 | |
| RoBERTa-base + OS (unif.)Paradigm=BERT-family (Supervised), Input / Loss=[CTX]/[TGT], Std CE + OS(120), LR 2e-5, Epochs=62026.05 | 61.8 | 28.93 | — | — | — | — | — | — | |
| RoBERTa-base + OS (tgt.)Paradigm=BERT-family (Supervised), Input / Loss=[CTX]/[TGT], Std CE + tgt. OS, LR 2e-5, Epochs=82026.05 | 61.4 | 24.3 | — | — | — | — | — | — | |
| DeBERTa-v3-base (5-fold)Paradigm=BERT-family (Supervised), Input / Loss=[CTX]/[TGT], Wtd CE, LR 1.5e-5, Epochs=82026.05 | 59.1 | 23.58 | — | — | — | — | — | — | |
| RoBERTa-baseParadigm=BERT-family (Supervised), Input / Loss=[CTX]/[TGT], Wtd CE, LR 2e-5, Epochs=62026.05 | 51.3 | 26.97 | — | — | — | — | — | — | |
| RoBERTa-base (len=320)Paradigm=BERT-family (Supervised), Input / Loss=[CTX]/[TGT], Wtd CE, LR 1.5e-5, Epochs=62026.05 | 47.9 | 27.63 | — | — | — | — | — | — | |
| Qwen3-8BParadigm=Zero-Shot LLM Inference2026.05 | 34.22 | — | 17.73 | 16.7 | 15.36 | — | — | — | |
| Llama 3.1-8BParadigm=Zero-Shot LLM Inference2026.05 | 30.36 | — | 19.58 | 19.99 | 15.84 | — | — | — | |
| Ministral-8BParadigm=Zero-Shot LLM Inference2026.05 | 24.06 | — | 25.17 | 14.81 | 8.41 | — | — | — | |
| Mistral-7B-v0.3 (Kaggle)Paradigm=LLM Fine-Tuning (LoRA)2026.05 | 14.44 | — | — | — | — | — | — | 10.23 | |
| MentalBERT-baseParadigm=BERT-family (Supervised), Input / Loss=Flat SEP k=5, Wtd CE, LR 2e-5, Epochs=52026.05 | — | 24 | — | — | — | — | — | — | |
| MentalBERT+RoBERTa (ens.)Paradigm=BERT-family (Supervised), Input / Loss=Flat SEP k=10, Wtd CE, LR 2e/1e-5, Epochs=5/82026.05 | — | 24 | — | — | — | — | — | — | |
| MentalRoBERTa-baseParadigm=BERT-family (Supervised), Input / Loss=Flat SEP k=10, Wtd CE, LR 1e-5, Epochs=102026.05 | — | 22 | — | — | — | — | — | — |