Metaphor Prediction on VUA-18 (test)
78.2Binary F1MelBert
Evaluation Results
| Method | Links | |
|---|---|---|
| MelBertEvaluation protocol=fine-tuned, Training dataset=VUA-18 (train), Evaluation target=target words2026.04 | 78.2 | |
| ConceptFrameMetEvaluation protocol=fine-tuned, Training dataset=VUA-18 (train), Evaluation target=target words2026.04 | 76.7 | |
| FrameBertEvaluation protocol=fine-tuned, Training dataset=VUA-18 (train), Evaluation target=target words2026.04 | 76.6 | |
| Gemini 2.5Evaluation protocol=zero-shot, Evaluation target=target words2026.04 | 34.1 | |
| Claude Sonnet 4.0Evaluation protocol=zero-shot, Evaluation target=target words2026.04 | 33 | |
| Random baseline2026.04 | 22.2 |