Subject-Verb Agreement on Subject-Verb Agreement (SVA) (standard)
0.01CMDEAP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EAPModel=OPT-1.3B2026.02 | 0.01 | 0.99 | |
| EAP-IG-inputsModel=OPT-1.3B2026.02 | 0.01 | 1 | |
| EAP-IG-inputsModel=Llama3.2-1B2026.02 | 0.03 | 0.98 | |
| EAPModel=Llama3.2-1B2026.02 | 0.04 | 1 | |
| EAP-IG-inputsModel=GPT2-Small2026.02 | 0.05 | 0.95 | |
| EAPModel=Qwen2.5-0.5B2026.02 | 0.05 | 0.96 | |
| EAP-IG-inputsModel=Qwen2.5-0.5B2026.02 | 0.05 | 0.99 | |
| Circuit FingerprintModel=Llama3.2-1B2026.02 | 0.05 | 0.96 | |
| Circuit FingerprintModel=OPT-1.3B2026.02 | 0.05 | 0.95 | |
| EAPModel=GPT2-Small2026.02 | 0.06 | 0.94 | |
| Circuit FingerprintModel=Qwen2.5-0.5B2026.02 | 0.06 | 0.94 | |
| Circuit FingerprintModel=GPT2-Small2026.02 | 0.09 | 0.91 |