List your company

Knowledge Attribution Causal Ablation on MultiLoKo (test)

50.1Ablation Success RateXICI
1.01213.75626.539.244Mar 17, 2026

Evaluation results

MethodLinks
XICIModel=GLM-4.5-Air, Details=45 MoE layers, 5760 total routed experts, Configuration=max 25, τ = 0.01, layers 6-402026.0350.14.245.91583129012515.21,75228
XICIModel=Qwen3-30B-A3B-Instruct-2507, Details=48 MoE layers, 6144 total experts, Configuration=max 25, τ = 0.005, layers 6-422026.0334.5331.6139312701029.11,00510
Random Question-Shuffling (baseline)Model=Qwen3-30B-A3B-Instruct-2507, Details=48 MoE layers, 6144 total experts, Configuration=max 25, τ = 0.005, layers 6-422026.037.32.74.6———————
Random Question-Shuffling (baseline)Model=GLM-4.5-Air, Details=45 MoE layers, 5760 total routed experts, Configuration=max 25, τ = 0.01, layers 6-402026.036.633.6———————
Random Expert Set of Same Size (baseline)Model=GLM-4.5-Air, Details=45 MoE layers, 5760 total routed experts, Configuration=max 25, τ = 0.01, layers 6-402026.034.13.40.7———————
Random Expert Set of Same Size (baseline)Model=Qwen3-30B-A3B-Instruct-2507, Details=48 MoE layers, 6144 total experts, Configuration=max 25, τ = 0.005, layers 6-422026.032.91.81.1———————