Circuit Discovery on IOI (AUC)
83.6AUCHISP
Evaluation Results
| Method | Links | |
|---|---|---|
| HISPGranularity=Edge-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.04 | 83.6 | |
| HISPGranularity=Edge-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.04 | 79.2 | |
| HISPGranularity=Node-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.04 | 72.8 | |
| HISPGranularity=Node-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.04 | 67.1 | |
| SPGranularity=Node-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.04 | 60.5 | |
| ACDCGranularity=Edge-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.04 | 53.9 | |
| SPGranularity=Edge-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.04 | 48.6 | |
| SPGranularity=Node-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.04 | 47.9 | |
| ACDCGranularity=Node-level, Optimization Objective=KL Divergence, Ablation Type=Zero Ablation2023.04 | 45.8 | |
| ACDCGranularity=Edge-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.04 | 44.7 | |
| ACDCGranularity=Node-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.04 | 42.4 | |
| SPGranularity=Edge-level, Optimization Objective=Task-specific Loss, Ablation Type=Zero Ablation2023.04 | 39.3 |