# Psychological defense mechanism classification on PSYDEFCONV (test)

Source: [Psychological defense mechanism classification on PSYDEFCONV (test)](<https://www.sota2.com/research/sota/psychological-defense-mechanism-classification-on-psydefconv-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:31:10.178Z

Evaluation of Psychological defense mechanism classification performance on the PSYDEFCONV test set, reporting Accuracy, Precision, Recall, and F1 score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Psychological defense mechanism classification |
| Dataset (including any stated split) | PSYDEFCONV (test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/psychological-defense-mechanism-classification-on-psydefconv-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/psychological-defense-mechanism-classification-on-psydefconv-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/psychological-defense-mechanism-classification-on-psydefconv-test.md?metric=Recall>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/psychological-defense-mechanism-classification-on-psydefconv-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Ministral-8B | 64.83 | Not recorded | 69438aa2423ea422657295a0 |
| InternLM3-8B | 63.98 | Not recorded | 69438aa2423ea422657295a0 |
| Llama3.1-8B | 62.92 | Not recorded | 69438aa2423ea422657295a0 |
| GLM-4-9B | 62.92 | Not recorded | 69438aa2423ea422657295a0 |
| Qwen3-8B | 61.44 | Not recorded | 69438aa2423ea422657295a0 |
| Qwen3-4B | 60.59 | Not recorded | 69438aa2423ea422657295a0 |
| Gemini 2.5 Pro | 56.36 | Not recorded | 69438aa2423ea422657295a0 |
| DeepSeek-V3.2 | 55.72 | Not recorded | 69438aa2423ea422657295a0 |
| GPT-5 mini | 54.03 | Not recorded | 69438aa2423ea422657295a0 |
| GPT-5 | 52.75 | Not recorded | 69438aa2423ea422657295a0 |
| Qwen3-Next | 44.28 | Not recorded | 69438aa2423ea422657295a0 |
| Kimi-K2 | 41.1 | Not recorded | 69438aa2423ea422657295a0 |
| Qwen3-Next | 40.89 | Not recorded | 69438aa2423ea422657295a0 |
| DeepSeek-V3.2 | 39.83 | Not recorded | 69438aa2423ea422657295a0 |

### Ministral-8B

Accuracy: 64.83. Result ID: 6996bbfb5698665ec406ce7d.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fine-tuned"}. This record does not assert independent reproduction.

### InternLM3-8B

Accuracy: 63.98. Result ID: 6996bbfb5698665ec406ce81.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72b31e209131cea57feb.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fine-tuned"}. This record does not assert independent reproduction.

### Llama3.1-8B

Accuracy: 62.92. Result ID: 6996bbfb5698665ec406ce7c.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fine-tuned"}. This record does not assert independent reproduction.

### GLM-4-9B

Accuracy: 62.92. Result ID: 6996bbfb5698665ec406ce7e.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74521e209131cea610b6.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fine-tuned"}. This record does not assert independent reproduction.

### Qwen3-8B

Accuracy: 61.44. Result ID: 6996bbfb5698665ec406ce80.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fine-tuned"}. This record does not assert independent reproduction.

### Qwen3-4B

Accuracy: 60.59. Result ID: 6996bbfb5698665ec406ce7f.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fine-tuned"}. This record does not assert independent reproduction.

### Gemini 2.5 Pro

Accuracy: 56.36. Result ID: 6996bbfb5698665ec406ce76.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c311e209131cea8cef5.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot Prompted"}. This record does not assert independent reproduction.

### DeepSeek-V3.2

Accuracy: 55.72. Result ID: 6996bbfb5698665ec406ce79.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7066a.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot Prompted","Thinking Process":"enabled"}. This record does not assert independent reproduction.

### GPT-5 mini

Accuracy: 54.03. Result ID: 6996bbfb5698665ec406ce75.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot Prompted"}. This record does not assert independent reproduction.

### GPT-5

Accuracy: 52.75. Result ID: 6996bbfb5698665ec406ce74.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot Prompted"}. This record does not assert independent reproduction.

### Qwen3-Next

Accuracy: 44.28. Result ID: 6996bbfb5698665ec406ce7b.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot Prompted","Thinking Process":"enabled"}. This record does not assert independent reproduction.

### Kimi-K2

Accuracy: 41.1. Result ID: 6996bbfb5698665ec406ce77.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a1.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot Prompted"}. This record does not assert independent reproduction.

### Qwen3-Next

Accuracy: 40.89. Result ID: 6996bbfb5698665ec406ce7a.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot Prompted","Thinking Process":"disabled"}. This record does not assert independent reproduction.

### DeepSeek-V3.2

Accuracy: 39.83. Result ID: 6996bbfb5698665ec406ce78.

[Reporting paper](<https://www.sota2.com/research/paper/69438aa2423ea422657295a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7066a.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot Prompted","Thinking Process":"disabled"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
