Indirect Object Identification on MIB (IOI Standard)
0CMDEAP-IG-inputs
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EAP-IG-inputsModel=OPT-1.3B2026.02 | 0 | 150 | |
| EAP-IG-inputsModel=Qwen2.5-0.5B2026.02 | 0.01 | 100 | |
| EAP-IG-inputsModel=Llama3.2-1B2026.02 | 0.01 | 99 | |
| EAPModel=OPT-1.3B2026.02 | 0.01 | 99 | |
| Circuit FingerprintModel=OPT-1.3B2026.02 | 0.01 | 99 | |
| EAPModel=Llama3.2-1B2026.02 | 0.02 | 99 | |
| Circuit FingerprintModel=Llama3.2-1B2026.02 | 0.02 | 99 | |
| EAPModel=GPT2-Small2026.02 | 0.03 | 97 | |
| EAP-IG-inputsModel=GPT2-Small2026.02 | 0.03 | 97 | |
| Circuit FingerprintModel=Qwen2.5-0.5B2026.02 | 0.04 | 96 | |
| EAPModel=Qwen2.5-0.5B2026.02 | 0.05 | 95 | |
| Circuit FingerprintModel=GPT2-Small2026.02 | 0.06 | 98 |