Circuit Localization on IOI
3.54CPRGIM
Evaluation Results
| Method | Links | |
|---|---|---|
| GIMModel=Gemma-22025.05 | 3.54 | |
| EAP-IG-inputsModel=Gemma-22025.05 | 3.2 | |
| GIMModel=Llama-3.12025.05 | 2.54 | |
| EActPModel=GPT-22025.05 | 2.3 | |
| GIMModel=GPT-22025.05 | 2.24 | |
| Hybrid-ensModel=GPT-22025.05 | 2.23 | |
| EAP-IG-inputsModel=Llama-3.12025.05 | 2.08 | |
| EAP-IG-activationsModel=Gemma-22025.05 | 2.07 | |
| GIMModel=Qwen-2.52025.05 | 2.02 | |
| Hybrid-ensModel=Qwen-2.52025.05 | 1.88 | |
| EAP-IG-inputsModel=GPT-22025.05 | 1.85 | |
| EAP-IG-activationsModel=GPT-22025.05 | 1.82 | |
| EAP-IG-activationsModel=Qwen-2.52025.05 | 1.63 | |
| EAP-IG-inputsModel=Qwen-2.52025.05 | 1.63 | |
| EAP-IG-activationsModel=Llama-3.12025.05 | 1.6 | |
| EAPModel=Gemma-22025.05 | 1.29 | |
| EActPModel=Qwen-2.52025.05 | 1.21 | |
| EAPModel=GPT-22025.05 | 1.2 | |
| UGSModel=Qwen-2.52025.05 | 0.98 | |
| UGSModel=GPT-22025.05 | 0.97 | |
| EAPModel=Llama-3.12025.05 | 0.85 | |
| IFRModel=GPT-22025.05 | 0.58 | |
| IFRModel=Qwen-2.52025.05 | 0.31 | |
| RandomModel=Gemma-22025.05 | 0.3 | |
| RandomModel=Qwen-2.52025.05 | 0.28 | |
| EAPModel=Qwen-2.52025.05 | 0.26 | |
| RandomModel=GPT-22025.05 | 0.25 | |
| RandomModel=Llama-3.12025.05 | 0.25 | |
| IFRModel=Gemma-22025.05 | 0.25 | |
| IFRModel=Llama-3.12025.05 | 0.09 |