Indirect Object Identification on IOI (500 randomly-sampled examples)
0.9182AlignmentGPT2 / DistilGPT2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT2 / DistilGPT2Model pair=GPT2 / DistilGPT22025.05 | 0.9182 | 3.6974 | 1.3129 | |
| BERT / DistilBERTModel pair=BERT / DistilBERT2025.05 | 0.8803 | 1.8022 | 2.2498 |