State modeling (Task 1.1) on CLPsych Task 1 2026
44.2Macro F1CUNY
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CUNYEntry=12026.05 | 44.2 | 1 | |
| Submission 3Method Type=Ensemble, Member count=7, Backbones=Qwen, Gemma, GPT2026.05 | 44.2 | — | |
| StateOfMINDEntry=22026.05 | 44.1 | 2 | |
| StateOfMINDEntry=32026.05 | 44 | 3 | |
| StateOfMINDEntry=42026.05 | 43.3 | 4 | |
| CUNYEntry=52026.05 | 43.1 | 5 | |
| Submission 2Method Type=Ensemble, Member count=5, Backbones=Qwen, Gemma2026.05 | 43.1 | — | |
| Meronym LabsEntry=62026.05 | 42 | 6 | |
| CUNYEntry=72026.05 | 41.6 | 7 | |
| Submission 1Method Type=Subelement-level ICL, k=3, Backbone=Gemma2026.05 | 41.6 | — | |
| Meronym LabsEntry=82026.05 | 41 | 8 | |
| USAIEntry=92026.05 | 41 | 9 | |
| USAIEntry=102026.05 | 40.3 | 10 | |
| Meronym LabsEntry=112026.05 | 39.9 | 11 | |
| AureviaEntry=122026.05 | 38.1 | 12 | |
| MKCEntry=132026.05 | 36.1 | 13 | |
| McMasterNLPEntry=142026.05 | 35.1 | 14 | |
| ullEntry=152026.05 | 33.5 | 15 | |
| ullEntry=162026.05 | 33.3 | 16 | |
| BLUEEntry=172026.05 | 31.8 | 17 | |
| NoviceTrioEntry=182026.05 | 31.3 | 18 | |
| AfrilanEntry=192026.05 | 29.7 | 19 | |
| AfrilanEntry=202026.05 | 28.5 | 20 | |
| psytechlabEntry=212026.05 | 27.4 | 21 | |
| DreamerNLplusEntry=222026.05 | 25.4 | 22 | |
| CLPsych2026 - BaselineEntry=232026.05 | 24.7 | 23 | |
| Official baselineMethod Type=One-shot ICL, Backbone=LLaMA-3.1-8B-Instruct2026.05 | 24.7 | — | |
| CtbuYEntry=242026.05 | 23.6 | 24 | |
| AfrilanEntry=252026.05 | 21.4 | 25 | |
| CtbuYEntry=262026.05 | 21 | 26 | |
| debjuEntry=272026.05 | 19.5 | 27 | |
| DrosophilAIEntry=282026.05 | 17.9 | 28 | |
| CSE_IIT_RoparEntry=292026.05 | 17.5 | 29 | |
| ullEntry=302026.05 | 11.9 | 30 | |
| CtbuYEntry=312026.05 | 11.8 | 31 | |
| CSE_IIT_RoparEntry=322026.05 | 10.6 | 32 | |
| DrosophilAIEntry=332026.05 | 9.9 | 33 | |
| debjyEntry=342026.05 | 0 | 34 |