Therapeutic principle classification on FAITH-M
63.3AccuracyCARE-Qwen3
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CARE-Qwen3Setting=decoder (Dec)2026.04 | 63.3 | 64.05 | 62.65 | 63.34 | |
| CARE-LLaMA 3.2Setting=decoder (Dec)2026.04 | 62.07 | 64.11 | 62.07 | 63.07 | |
| CARE-Qwen3 - (LC)Setting=label-context2026.04 | 57.08 | 58.06 | 57.02 | 57.2 | |
| CARE-Qwen3 - (LE)Setting=label-exclusive2026.04 | 53.81 | 54.04 | 53.02 | 53.08 | |
| Qwen3Setting=decoder (Dec)2026.04 | 45.47 | 45.1 | 45.38 | 38.56 | |
| LLaMA 3.2Setting=decoder (Dec)2026.04 | 44.91 | 44.78 | 44.91 | 37.9 | |
| LLaMA 3.1Setting=decoder (Dec)2026.04 | 43.36 | 42.81 | 43.46 | 37.73 | |
| ALBERTSetting=encoder (Enc)2026.04 | 42.32 | 41.58 | 42.32 | 34.49 | |
| MentalBARTSetting=encoder-decoder (En-De)2026.04 | 41.26 | 46.08 | 41.27 | 27.3 | |
| Phi4Setting=decoder (Dec)2026.04 | 36.89 | 37.91 | 35.81 | 37.37 | |
| GemmaSetting=decoder (Dec)2026.04 | 36.56 | 37.23 | 36.56 | 36.88 | |
| DeBERTaSetting=encoder (Enc)2026.04 | 33.79 | 35.32 | 33.79 | 34.52 | |
| BARTSetting=encoder-decoder (En-De)2026.04 | 33.34 | 34.61 | 33.34 | 33.96 | |
| GPT-4oSetting=zero-shot (ZS)2026.04 | 31.09 | 36.19 | 31.09 | 30.49 | |
| GPT-4oSetting=few-shot (FS)2026.04 | 30.44 | 32.28 | 30.44 | 22.4 | |
| RoBERTaSetting=encoder (Enc)2026.04 | 30.09 | 33.08 | 30.09 | 30.72 | |
| Mental LlamaSetting=zero-shot (ZS)2026.04 | 27.94 | 8.69 | 27.74 | 12.97 | |
| Mental LlamaSetting=few-shot (FS)2026.04 | 27.74 | 8.62 | 27.74 | 12.97 | |
| MentalBERTSetting=encoder (Enc)2026.04 | 23.85 | 30.05 | 23.85 | 25.73 |