Out-of-Distribution Agent Reasoning on WikiTQ (OOD)
74.68OOD WikiTQ ScoreHuman-Written
Evaluation results
| Method | Links | |
|---|---|---|
| Human-WrittenSkill User=Qwen3.5-122B-A10B2026.03 | 74.68 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-122B-A10B, Condition=Creation (init: Parametric), Refinement Component=+Error2026.03 | 57.65 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-35B-A3B, Condition=Deepening (init: Human-Written), Refinement Component=+Success2026.03 | 43.23 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-35B-A3B, Condition=Deepening (init: Human-Written), Refinement Component=+Combined2026.03 | 42.2 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-122B-A10B, Condition=Creation (init: Parametric), Refinement Component=+Combined2026.03 | 32.32 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-122B-A10B, Condition=Creation (init: Parametric), Refinement Component=+Combined2026.03 | 30.82 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-35B-A3B, Condition=Creation (init: Parametric), Refinement Component=+Success2026.03 | 30.36 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-35B-A3B, Condition=Creation (init: Parametric), Refinement Component=+Combined2026.03 | 29.7 | |
| ParametricSkill User=Qwen3.5-122B-A10B2026.03 | 23.73 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-122B-A10B, Condition=Creation (init: Parametric), Refinement Component=+Success2026.03 | 23.7 | |
| No SkillSkill User=Qwen3.5-122B-A10B2026.03 | 21.5 | |
| ParametricSkill User=Qwen3.5-35B-A3B2026.03 | 20.14 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-35B-A3B, Condition=Creation (init: Parametric), Refinement Component=+Combined2026.03 | 18 | |
| No SkillSkill User=Qwen3.5-35B-A3B2026.03 | 13.33 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-35B-A3B, Condition=Creation (init: Parametric), Refinement Component=+Error2026.03 | 12.66 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-35B-A3B, Condition=Deepening (init: Human-Written), Refinement Component=+Success2026.03 | 12.09 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-35B-A3B, Condition=Deepening (init: Human-Written), Refinement Component=+Error2026.03 | 9.26 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-122B-A10B, Condition=Creation (init: Parametric), Refinement Component=+Success2026.03 | 9.09 | |
| Human-WrittenSkill User=Qwen3.5-35B-A3B2026.03 | 9.02 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-122B-A10B, Condition=Creation (init: Parametric), Refinement Component=+Error2026.03 | 7.89 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-35B-A3B, Condition=Deepening (init: Human-Written), Refinement Component=+Combined2026.03 | 6.64 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-122B-A10B, Condition=Deepening (init: Human-Written), Refinement Component=+Combined2026.03 | 4.56 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-35B-A3B, Condition=Creation (init: Parametric), Refinement Component=+Success2026.03 | 3.31 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-35B-A3B, Condition=Deepening (init: Human-Written), Refinement Component=+Error2026.03 | 2.71 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-122B-A10B, Condition=Deepening (init: Human-Written), Refinement Component=+Combined2026.03 | 2.65 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-35B-A3B, Condition=Creation (init: Parametric), Refinement Component=+Error2026.03 | 2.06 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-122B-A10B, Condition=Deepening (init: Human-Written), Refinement Component=+Error2026.03 | 1.62 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-122B-A10B, Condition=Deepening (init: Human-Written), Refinement Component=+Success2026.03 | 1.46 | |
| Trace2SkillSkill Author=Qwen3.5-35B-A3B, Skill User=Qwen3.5-122B-A10B, Condition=Deepening (init: Human-Written), Refinement Component=+Error2026.03 | -6.36 | |
| Trace2SkillSkill Author=Qwen3.5-122B-A10B, Skill User=Qwen3.5-122B-A10B, Condition=Deepening (init: Human-Written), Refinement Component=+Success2026.03 | -10.35 |