Analogy Solving on Green's Analogy (Near-Analogy)
87.5AccuracyLLaMa-3.1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLaMa-3.1Intervention=None2026.01 | 87.5 | — | |
| vCBackbone=LLaMa-3.1, Affine transformation=g() affine2026.01 | 85 | 2 | |
| IFV-CFVBackbone=LLaMa-3.1, Affine transformation=None2026.01 | 82.5 | 2.4 | |
| IFV-CFVBackbone=LLaMa-3.1, Affine transformation=g() affine2026.01 | 82 | 3.4 | |
| vCBackbone=GPT-J, Affine transformation=g() affine2026.01 | 78 | 3 | |
| vCBackbone=LLaMa-3.1, Affine transformation=None2026.01 | 78 | 5.5 | |
| LLaMa-2Intervention=None2026.01 | 77.5 | — | |
| GPT-JIntervention=None2026.01 | 75 | — | |
| IFV-CFVBackbone=LLaMa-2, Affine transformation=g() affine2026.01 | 75 | 2.4 | |
| vCBackbone=LLaMa-2, Affine transformation=g() affine2026.01 | 74.5 | 2.5 | |
| vCBackbone=GPT-J, Affine transformation=None2026.01 | 74 | 2 | |
| IFV-CFVBackbone=LLaMa-2, Affine transformation=None2026.01 | 74 | 1.2 | |
| vCBackbone=LLaMa-2, Affine transformation=None2026.01 | 73 | 5.5 | |
| IFV-CFVBackbone=GPT-J, Affine transformation=None2026.01 | 69.5 | 1 | |
| IFV-CFVBackbone=GPT-J, Affine transformation=g() affine2026.01 | 69.5 | 5.7 | |
| vCBackbone=GPT-2, Affine transformation=g() affine2026.01 | 58.5 | 11.6 | |
| vCBackbone=GPT-2, Affine transformation=None2026.01 | 53.4 | 5.5 | |
| GPT-2Intervention=None2026.01 | 50 | — | |
| IFV-CFVBackbone=GPT-2, Affine transformation=None2026.01 | 48 | 1 | |
| IFV-CFVBackbone=GPT-2, Affine transformation=g() affine2026.01 | 47.5 | 3.4 |