Metaphor on MUNCH
98.6AUROCFull Rep.
Evaluation Results
| Method | Links | |
|---|---|---|
| Full Rep.Model=Gemma2-9B, Representation Type=Full Representation2026.04 | 98.6 | |
| Full Rep.Model=GPT-OSS-20B, Representation Type=Full Representation2026.04 | 97.9 | |
| SubspaceModel=Gemma2-9B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 96.5 | |
| Full Rep.Model=Qwen3-8B, Representation Type=Full Representation2026.04 | 96.3 | |
| Full Representation ClassifierBackbone=Llama-3.1-8B, Representation Type=Full Rep., Evaluation Protocol=Trained2026.04 | 95.1 | |
| SubspaceModel=GPT-OSS-20B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 93.2 | |
| one-directional concreteness axisBackbone=Llama-3.1-8B, Representation Type=Subspace, Evaluation Protocol=Zero-shot2026.04 | 93.2 | |
| SubspaceModel=Qwen3-8B, Representation Type=Unidirectional Concreteness Subspace2026.04 | 92 |