Knowledge cutoff success on Counterfactual
71.2Hard Unlearn Success RateQR→SR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QR→SRModel=gpt-oss-120b, Base Instruction=P12026.06 | 71.2 | 82.4 | |
| SR→QRModel=gpt-oss-120b, Base Instruction=P12026.06 | 70.2 | 81.9 | |
| QRModel=gpt-oss-120b, Base Instruction=P12026.06 | 68.9 | 77 | |
| SRModel=gpt-oss-120b, Base Instruction=P12026.06 | 68.4 | 77.6 | |
| SR→QRModel=GPT-4o, Base Instruction=P12026.06 | 66.4 | 74 | |
| SRModel=GPT-4o, Base Instruction=P12026.06 | 64.6 | 77.2 | |
| P1Model=gpt-oss-120b2026.06 | 61.6 | 68.3 | |
| ZS-CoTModel=gpt-oss-120b, Base Instruction=P12026.06 | 61.2 | 67.4 | |
| QR→SRModel=GPT-4o, Base Instruction=P12026.06 | 59.7 | 67.8 | |
| SR→QRModel=Llama-3.3-70B-Instruct, Base Instruction=P12026.06 | 58.6 | 65.1 | |
| ZS-PSModel=gpt-oss-120b, Base Instruction=P12026.06 | 56.4 | 62.6 | |
| QRModel=GPT-4o, Base Instruction=P12026.06 | 55.1 | 59.4 | |
| SRModel=Llama-3.3-70B-Instruct, Base Instruction=P12026.06 | 53.2 | 65.5 | |
| P1Model=GPT-4o2026.06 | 50.5 | 56.7 | |
| QR→SRModel=Llama-3.3-70B-Instruct, Base Instruction=P12026.06 | 50.2 | 58.8 | |
| QRModel=Llama-3.3-70B-Instruct, Base Instruction=P12026.06 | 43.6 | 52.9 | |
| P1Model=Llama-3.3-70B-Instruct2026.06 | 39 | 51.4 | |
| ZS-PSModel=Llama-3.3-70B-Instruct, Base Instruction=P12026.06 | 36.4 | 45.4 | |
| ZS-CoTModel=Llama-3.3-70B-Instruct, Base Instruction=P12026.06 | 32.6 | 41.6 | |
| ZS-PSModel=GPT-4o, Base Instruction=P12026.06 | 31.7 | 36 | |
| ZS-CoTModel=GPT-4o, Base Instruction=P12026.06 | 25.1 | 28.6 |