Medical Classification on CRF 15% 1.0 (test)
60.3Macro F1DecSelfMask-Qwen3-8B
Evaluation results
| Method | Links | |
|---|---|---|
| DecSelfMask-Qwen3-8BAdaptation Strategy=Probing, Configuration=DSM2026.06 | 60.3 | |
| DecSelfMask-Llama3-8BAdaptation Strategy=Probing, Configuration=DSM2026.06 | 55.8 | |
| Llama3-8BAdaptation Strategy=Probing, Configuration=Base2026.06 | 55.6 | |
| Qwen3-8BAdaptation Strategy=Probing, Configuration=Base2026.06 | 52.5 | |
| DecSelfMask-Gemma3-4BAdaptation Strategy=Probing, Configuration=DSM2026.06 | 47.5 | |
| DecSelfMask-Llama3-1BAdaptation Strategy=Probing, Configuration=DSM2026.06 | 47 | |
| DecSelfMask-Qwen3-1.7BAdaptation Strategy=Probing, Configuration=DSM2026.06 | 46.8 | |
| DecSelfMask-Gemma3-4BAdaptation Strategy=SFT, Configuration=DSM2026.06 | 44.4 | |
| DecSelfMask-Llama3-8BAdaptation Strategy=SFT, Configuration=DSM2026.06 | 42.9 | |
| DecSelfMask-Qwen3-8BAdaptation Strategy=SFT, Configuration=DSM2026.06 | 40.4 | |
| Gemma3-4BAdaptation Strategy=SFT, Configuration=Base2026.06 | 37.5 | |
| Gemma3-4BAdaptation Strategy=Probing, Configuration=Base2026.06 | 36.1 | |
| Llama3-8BAdaptation Strategy=SFT, Configuration=Base2026.06 | 35.3 | |
| Llama3-1BAdaptation Strategy=Probing, Configuration=Base2026.06 | 34.1 | |
| Qwen3-1.7BAdaptation Strategy=Probing, Configuration=Base2026.06 | 33.3 | |
| Qwen3-8BAdaptation Strategy=SFT, Configuration=Base2026.06 | 32.5 | |
| Qwen3-1.7BAdaptation Strategy=SFT, Configuration=Base2026.06 | 30.9 | |
| DecSelfMask-Qwen3-1.7BAdaptation Strategy=SFT, Configuration=DSM2026.06 | 22.3 | |
| Llama3-1BAdaptation Strategy=SFT, Configuration=Base2026.06 | 21.9 | |
| DecSelfMask-Llama3-1BAdaptation Strategy=SFT, Configuration=DSM2026.06 | 19.69 |