Agreement, Reflexive, Number, Subject-Relative Clause on CausalGym agr_refl_num_subj-relc
100CompletenessHDMI
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HDMIModel=Meta-Llama-3-8B-Instruct2026.05 | 100 | 100 | 100 | |
| HDMIModel=EleutherAI/pythia-70m2026.05 | 100 | 100 | 100 | |
| FGSMModel=Meta-Llama-3-8B-Instruct2026.05 | 100 | 100 | 100 | |
| AlterRepModel=Meta-Llama-3-8B-Instruct2026.05 | 98.98 | 100 | 99.49 | |
| PGDModel=Meta-Llama-3-8B-Instruct2026.05 | 96.36 | 100 | 98.15 | |
| AlterRepModel=EleutherAI/pythia-70m2026.05 | 50 | 100 | 66.67 | |
| FGSMModel=EleutherAI/pythia-70m2026.05 | 49.63 | 100 | 66.34 | |
| PGDModel=EleutherAI/pythia-70m2026.05 | 49.12 | 100 | 65.88 |