Analogical Reasoning on ARN Near Analogy
79AccuracyLLM-CoT
Evaluation Results
| Method | Links | |
|---|---|---|
| LLM-CoTModel (Backbone)=Qwen3-8B2026.03 | 79 | |
| LLM-ZSModel (Backbone)=Llama3.1-8B2026.03 | 76 | |
| LLM-CoTModel (Backbone)=Llama3.1-8B2026.03 | 75 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=false2026.03 | 73 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=false2026.03 | 69 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 67 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=true, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 67 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 66 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=true2026.03 | 65 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=true, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 64 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=true, Evaluative Abstraction=true, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 63 | |
| SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=true2026.03 | 62 | |
| SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=true, Evaluative Abstraction=true, Stage Abstraction=false, Narrative Arc Abstraction=false2026.03 | 62 | |
| LLM-ZSModel (Backbone)=Qwen3-8B2026.03 | 52 |