List your company

Knowledge Attribution Causal Ablation on G-MMLU (test)

47.5Ablation Success RateXICI
3.09214.62126.1537.679Mar 17, 2026

Evaluation results

MethodLinks
XICIModel=GLM-4.5-Air, Details=45 MoE layers, 5760 total routed experts, Configuration=max 25, τ = 0.01, layers 6-402026.0347.53.444.112242285122241,32217
XICIModel=Qwen3-30B-A3B-Instruct-2507, Details=48 MoE layers, 6144 total experts, Configuration=max 25, τ = 0.005, layers 6-422026.0337.63.434.21244224012422.81,01714
Random Question-Shuffling (baseline)Model=GLM-4.5-Air, Details=45 MoE layers, 5760 total routed experts, Configuration=max 25, τ = 0.01, layers 6-402026.03844———————
Random Question-Shuffling (baseline)Model=Qwen3-30B-A3B-Instruct-2507, Details=48 MoE layers, 6144 total experts, Configuration=max 25, τ = 0.005, layers 6-422026.037.64.23.4———————
Random Expert Set of Same Size (baseline)Model=Qwen3-30B-A3B-Instruct-2507, Details=48 MoE layers, 6144 total experts, Configuration=max 25, τ = 0.005, layers 6-422026.035.13.61.5———————
Random Expert Set of Same Size (baseline)Model=GLM-4.5-Air, Details=45 MoE layers, 5760 total routed experts, Configuration=max 25, τ = 0.01, layers 6-402026.034.83.71———————