Metonymy on ConMeC
66.5AUROCFull Rep.
Evaluation results
| Method | Links | |
|---|---|---|
| Full Rep.Model=GPT-OSS-20B, Representation Type=Full Representation2026.04 | 66.5 | |
| Full Representation ClassifierBackbone=Llama-3.1-8B, Representation Type=Full Rep., Evaluation Protocol=Trained2026.04 | 62.6 | |
| Full Rep.Model=Gemma2-9B, Representation Type=Full Representation2026.04 | 61.5 | |
| SubspaceModel=Gemma2-9B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 61.2 | |
| one-directional concreteness axisBackbone=Llama-3.1-8B, Representation Type=Subspace, Evaluation Protocol=Zero-shot2026.04 | 60.2 | |
| Full Rep.Model=Qwen3-8B, Representation Type=Full Representation2026.04 | 59.4 | |
| SubspaceModel=GPT-OSS-20B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 59.3 | |
| SubspaceModel=Qwen3-8B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 55.4 |