List your company

Analogical Reasoning on MCQ

46AccuracySM
14.822.93139.1Mar 31, 2026

Evaluation results

MethodLinks
SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=true, Evaluative Abstraction=true, Stage Abstraction=false, Narrative Arc Abstraction=false2026.0346
SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=true, Evaluative Abstraction=true, Stage Abstraction=false, Narrative Arc Abstraction=false2026.0345
SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=true, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.0342
LLM-CoTModel (Backbone)=Qwen3-8B2026.0341
SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=true, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.0341
LLM-ZSModel (Backbone)=Qwen3-8B2026.0337
SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=true2026.0330
SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=false2026.0329
LLM-CoTModel (Backbone)=Llama3.1-8B2026.0328
SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=true2026.0327
SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=true, Narrative Arc Abstraction=false2026.0324
LLM-ZSModel (Backbone)=Llama3.1-8B2026.0323
SMModel (Backbone)=Qwen3-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.0317
SMModel (Backbone)=Llama3.1-8B, Conceptual Abstraction=false, Evaluative Abstraction=false, Stage Abstraction=false, Narrative Arc Abstraction=false2026.0316