Analogical Reasoning on ARN Far Analogy
52AccuracyLLM-ZS
Evaluation Results
| Method | Links | |
|---|---|---|
| LLM-ZSModel (Backbone)=Qwen3-8B2026.03 | 52 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=true, Evaluative Abstraction=true, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 47 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=true, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 46 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=true, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 46 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=true2026.03 | 45 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=true, Evaluative Abstraction=true, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 45 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=true2026.03 | 43 | |
| LLM-CoTModel (Backbone)=Qwen3-8B2026.03 | 42 | |
| LLM-ZSModel (Backbone)=Llama3.1-8B2026.03 | 42 | |
| LLM-CoTModel (Backbone)=Llama3.1-8B2026.03 | 41 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=false2026.03 | 40 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=false2026.03 | 36 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 24 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 20 |