State modeling (Task 1.2) on CLPsych Task 1 2026
0.917RMSEMeronym Labs
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Meronym LabsEntry=62026.05 | 0.917 | 1 | |
| USAIEntry=92026.05 | 0.942 | 2 | |
| AureviaEntry=122026.05 | 0.981 | 3 | |
| CUNYEntry=52026.05 | 0.989 | 4 | |
| StateOfMINDEntry=42026.05 | 0.994 | 5 | |
| Submission 2Method Type=Ensemble, Member count=5, Backbones=Qwen, Gemma2026.05 | 0.997 | — | |
| CUNYEntry=12026.05 | 1.007 | 6 | |
| Submission 3Method Type=Ensemble, Member count=7, Backbones=Qwen, Gemma, GPT2026.05 | 1.007 | — | |
| MKCEntry=132026.05 | 1.01 | 7 | |
| StateOfMINDEntry=22026.05 | 1.021 | 8 | |
| McMasterNLPEntry=142026.05 | 1.035 | 9 | |
| CUNYEntry=72026.05 | 1.041 | 10 | |
| Meronym LabsEntry=112026.05 | 1.041 | 11 | |
| Submission 1Method Type=Subelement-level ICL, k=3, Backbone=Gemma2026.05 | 1.047 | — | |
| StateOfMINDEntry=32026.05 | 1.094 | 12 | |
| CSE_IIT_RoparEntry=322026.05 | 1.146 | 13 | |
| DrosophilAIEntry=282026.05 | 1.154 | 14 | |
| debjyEntry=342026.05 | 1.156 | 15 | |
| ullEntry=162026.05 | 1.171 | 16 | |
| ullEntry=152026.05 | 1.185 | 17 | |
| Meronym LabsEntry=82026.05 | 1.212 | 18 | |
| NoviceTrioEntry=182026.05 | 1.255 | 19 | |
| DreamerNLplusEntry=222026.05 | 1.285 | 20 | |
| USAIEntry=102026.05 | 1.294 | 21 | |
| DrosophilAIEntry=332026.05 | 1.305 | 22 | |
| AfrilanEntry=252026.05 | 1.329 | 23 | |
| debjuEntry=272026.05 | 1.348 | 24 | |
| psytechlabEntry=212026.05 | 1.407 | 25 | |
| CLPsych2026 - BaselineEntry=232026.05 | 1.424 | 26 | |
| Official baselineMethod Type=One-shot ICL, Backbone=LLaMA-3.1-8B-Instruct2026.05 | 1.424 | — | |
| CtbuYEntry=312026.05 | 1.501 | 27 | |
| CtbuYEntry=262026.05 | 1.506 | 28 | |
| ullEntry=302026.05 | 1.517 | 29 | |
| AfrilanEntry=192026.05 | 1.585 | 31 | |
| CtbuYEntry=242026.05 | 1.585 | 30 | |
| CSE_IIT_RoparEntry=292026.05 | 1.59 | 32 | |
| BLUEEntry=172026.05 | 1.606 | 33 | |
| AfrilanEntry=202026.05 | 2.053 | 34 |