List your company
ResearchFormerly WizWand

Metaphor on MUNCH

98.6AUROCFull Rep.
91.73693.51895.397.082Apr 20, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Full Rep.Model=Gemma2-9B, Representation Type=Full Representation2026.0498.6
Full Rep.Model=GPT-OSS-20B, Representation Type=Full Representation2026.0497.9
SubspaceModel=Gemma2-9B, Representation Type=Unidirectional Concreteness Subspace2026.0496.5
Full Rep.Model=Qwen3-8B, Representation Type=Full Representation2026.0496.3
Full Representation ClassifierBackbone=Llama-3.1-8B, Representation Type=Full Rep., Evaluation Protocol=Trained2026.0495.1
SubspaceModel=GPT-OSS-20B, Representation Type=Unidirectional Concreteness Subspace2026.0493.2
one-directional concreteness axisBackbone=Llama-3.1-8B, Representation Type=Subspace, Evaluation Protocol=Zero-shot2026.0493.2
SubspaceModel=Qwen3-8B, Representation Type=Unidirectional Concreteness Subspace2026.0492