Coreference Resolution on Winogender
64.72AccuracyGIFT
Evaluation results
| Method | Links | |
|---|---|---|
| GIFTModel Size=32B2025.10 | 64.72 | |
| GRPOModel Size=32B2025.10 | 64.31 | |
| GEEPBackbone=BERT-base2021.10 | 62.9 | |
| GIFTModel Size=7B2025.10 | 61.39 | |
| InstructModel Size=32B2025.10 | 61.11 | |
| InstructModel Size=7B2025.10 | 60.97 | |
| EngramLayers (L)=182026.06 | 60.07 | |
| GRPOModel Size=7B2025.10 | 59.86 | |
| Raw GPTLayers (L)=182026.06 | 57.51 | |
| TN-gramLayers (L)=182026.06 | 56.41 | |
| TN-gramLayers (L)=92026.06 | 53.85 | |
| Raw GPTLayers (L)=92026.06 | 53.48 | |
| EngramLayers (L)=92026.06 | 53.48 | |
| BERT-SPPABackbone=BERT-base2021.10 | 50.7 | |
| BERT-baseBackbone=BERT-base2021.10 | 50 |