# Psychological defense mechanism classification on PsyDefDetect classes 1-8 (hidden test) Source: [Psychological defense mechanism classification on PsyDefDetect classes 1-8 (hidden test)]() Collection index: [llms.txt]() Data updated: 2026-05-11T09:56:31.379Z Evaluation of models for classifying psychological defense mechanisms using the PsyDefDetect dataset (classes 1-8, hidden test split), reporting macro-F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Psychological defense mechanism classification | | Dataset (including any stated split) | PsyDefDetect classes 1-8 (hidden test) | | Metric | Macro F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 9 of 9 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Macro F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Macro F1 Score | Result date | Report paper | | --- | --- | --- | --- | | 9V Min-SFT 9c + Min-LR 8c + Phi4-LR 8c | 42 | Not recorded | 6a0162b4dbc836b87d8232ad | | 9V Min-SFT 9c + Min-LR 8c + Llama-LR 8c | 41.7 | Not recorded | 6a0162b4dbc836b87d8232ad | | 9V Min-SFT 9c + Min-LR 8c + PCounsel-LR 8c | 41.4 | Not recorded | 6a0162b4dbc836b87d8232ad | | 6V Min-SFT 9c + Llama-LR 8c | 39.2 | Not recorded | 6a0162b4dbc836b87d8232ad | | 6V Min-SFT 9c + Min-LR 8c | 39.1 | Not recorded | 6a0162b4dbc836b87d8232ad | | 6V Min-SFT 9c + Phi4-LR 8c | 39.1 | Not recorded | 6a0162b4dbc836b87d8232ad | | 5V Min-SFT 9c (5 folds) | 37.3 | Not recorded | 6a0162b4dbc836b87d8232ad | | Baseline (Min-SFT 9c) | 31.5 | Not recorded | 6a0162b4dbc836b87d8232ad | | Min-SFT 9c full-train (single model) | 30.7 | Not recorded | 6a0162b4dbc836b87d8232ad | ### 9V Min-SFT 9c + Min-LR 8c + Phi4-LR 8c Macro F1 Score: 42. Result ID: 6a01a7ce47f34ce924e400bd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of voters":"9","Diversity axes":"Class + training + model","Data augmentation":"true","Model variants":"Phi4-LR 8c"}. This record does not assert independent reproduction. ### 9V Min-SFT 9c + Min-LR 8c + Llama-LR 8c Macro F1 Score: 41.7. Result ID: 6a01a7ce47f34ce924e400bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of voters":"9","Diversity axes":"Class + training + model","Data augmentation":"true","Model variants":"Llama-LR 8c"}. This record does not assert independent reproduction. ### 9V Min-SFT 9c + Min-LR 8c + PCounsel-LR 8c Macro F1 Score: 41.4. Result ID: 6a01a7ce47f34ce924e400bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of voters":"9","Diversity axes":"Class + training + model","Data augmentation":"true","Model variants":"PCounsel-LR 8c"}. This record does not assert independent reproduction. ### 6V Min-SFT 9c + Llama-LR 8c Macro F1 Score: 39.2. Result ID: 6a01a7ce47f34ce924e400ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of voters":"6","Diversity axes":"Class + training + model","Data augmentation":"true","Model variants":"Llama-LR 8c"}. This record does not assert independent reproduction. ### 6V Min-SFT 9c + Min-LR 8c Macro F1 Score: 39.1. Result ID: 6a01a7ce47f34ce924e400b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of voters":"6","Diversity axes":"Class + training","Data augmentation":"true"}. This record does not assert independent reproduction. ### 6V Min-SFT 9c + Phi4-LR 8c Macro F1 Score: 39.1. Result ID: 6a01a7ce47f34ce924e400b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of voters":"6","Diversity axes":"Class + training + model","Data augmentation":"true","Model variants":"Phi4-LR 8c"}. This record does not assert independent reproduction. ### 5V Min-SFT 9c (5 folds) Macro F1 Score: 37.3. Result ID: 6a01a7ce47f34ce924e400b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of voters":"5","Diversity axes":"none","Data augmentation":"true"}. This record does not assert independent reproduction. ### Baseline (Min-SFT 9c) Macro F1 Score: 31.5. Result ID: 6a01a7ce47f34ce924e400b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data augmentation":"false"}. This record does not assert independent reproduction. ### Min-SFT 9c full-train (single model) Macro F1 Score: 30.7. Result ID: 6a01a7ce47f34ce924e400b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data augmentation":"true"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.