Metonymy on MetFuse
98.2AUROCFull Rep.
Evaluation results
| Method | Links | |
|---|---|---|
| Full Rep.Model=Gemma2-9B, Representation Type=Full Representation2026.04 | 98.2 | |
| Full Rep.Model=GPT-OSS-20B, Representation Type=Full Representation2026.04 | 97.5 | |
| Full Rep.Model=Qwen3-8B, Representation Type=Full Representation2026.04 | 97 | |
| Full Representation ClassifierBackbone=Llama-3.1-8B, Representation Type=Full Rep., Evaluation Protocol=Trained2026.04 | 96.3 | |
| SubspaceModel=Gemma2-9B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 86.2 | |
| one-directional concreteness axisBackbone=Llama-3.1-8B, Representation Type=Subspace, Evaluation Protocol=Zero-shot2026.04 | 85.7 | |
| SubspaceModel=Qwen3-8B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 85.5 | |
| SubspaceModel=GPT-OSS-20B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 85.3 |