Analogy Solving on Green's Analogy Far-Analogy
75AccuracyvC
Evaluation results
| Method | Links | ||
|---|---|---|---|
| vCBackbone=LLaMa-2, Affine transformation=None2026.01 | 75 | 0.02 | |
| vCBackbone=LLaMa-2, Affine transformation=g() affine2026.01 | 74.5 | 0.115 | |
| vCBackbone=LLaMa-3.1, Affine transformation=g() affine2026.01 | 74 | 0.101 | |
| vCBackbone=LLaMa-3.1, Affine transformation=None2026.01 | 72 | 0.126 | |
| IFV-CFVBackbone=LLaMa-2, Affine transformation=g() affine2026.01 | 69 | 0.079 | |
| IFV-CFVBackbone=LLaMa-2, Affine transformation=None2026.01 | 67 | 0.054 | |
| IFV-CFVBackbone=LLaMa-3.1, Affine transformation=None2026.01 | 62 | 0.03 | |
| vCBackbone=GPT-J, Affine transformation=g() affine2026.01 | 61 | 0.054 | |
| LLaMa-2Intervention=None2026.01 | 60 | — | |
| LLaMa-3.1Intervention=None2026.01 | 57.5 | — | |
| vCBackbone=GPT-J, Affine transformation=None2026.01 | 56.5 | 0.042 | |
| IFV-CFVBackbone=LLaMa-3.1, Affine transformation=g() affine2026.01 | 56 | 0.081 | |
| IFV-CFVBackbone=GPT-J, Affine transformation=g() affine2026.01 | 50.5 | 0.024 | |
| IFV-CFVBackbone=GPT-J, Affine transformation=None2026.01 | 50 | 0 | |
| vCBackbone=GPT-2, Affine transformation=g() affine2026.01 | 44.5 | 0.087 | |
| GPT-JIntervention=None2026.01 | 42.5 | — | |
| IFV-CFVBackbone=GPT-2, Affine transformation=g() affine2026.01 | 41 | 0.074 | |
| vCBackbone=GPT-2, Affine transformation=None2026.01 | 38.5 | 0.012 | |
| IFV-CFVBackbone=GPT-2, Affine transformation=None2026.01 | 29 | 0.034 | |
| GPT-2Intervention=None2026.01 | 22.5 | — |