List your company
ResearchFormerly WizWand

Circuit Discovery on Docstring (AUC)

0.929AUCACDC
0.376760.520130.66350.80687Apr 28, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ACDCGranularity=Edge-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.040.929
ACDCGranularity=Edge-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.040.906
HISPGranularity=Node-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.040.889
HISPGranularity=Node-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.040.881
ACDCGranularity=Node-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.040.837
ACDCGranularity=Node-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.040.825
HISPGranularity=Edge-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.040.821
HISPGranularity=Edge-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.040.805
SPGranularity=Edge-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.040.482
SPGranularity=Edge-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.040.428
SPGranularity=Node-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.040.42
SPGranularity=Node-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.040.398