Entity Translation
56.6AccuracymT5 XL
Evaluation Results
| Method | Links | |
|---|---|---|
| mT5 XL#Params=11x, #L=101, Language Mode=Multilingual, Retrieval=w/ BM252022.12 | 56.6 | |
| NPM#Params=1.0x, Language Mode=English-only, Retrieval=w/ BM252022.12 | 52.4 | |
| BLOOM 7.1B#Params=20x, #L=46, Language Mode=Multilingual, Retrieval=w/ BM252022.12 | 26 | |
| OPT 13B#Params=37x, Language Mode=English-only, Retrieval=w/ BM252022.12 | 24.6 | |
| OPT 6.7B#Params=19x, Language Mode=English-only, Retrieval=w/ BM252022.12 | 22.3 | |
| mT5#Params=3.4x, #L=101, Language Mode=Multilingual, Retrieval=w/ BM252022.12 | 19 | |
| BLOOM 3B#Params=8.5x, #L=46, Language Mode=Multilingual, Retrieval=w/ BM252022.12 | 17.4 | |
| T5 3B#Params=8.5x, Language Mode=English-only, Retrieval=w/ BM252022.12 | 4.4 | |
| mT5 XL#Params=11x, #L=101, Language Mode=Multilingual, Retrieval=w/o BM252022.12 | 4.1 | |
| T5#Params=2.2x, Language Mode=English-only, Retrieval=w/ BM252022.12 | 1.9 | |
| mT5#Params=3.4x, #L=101, Language Mode=Multilingual, Retrieval=w/o BM252022.12 | 1.3 | |
| OPT 13B#Params=37x, Language Mode=English-only, Retrieval=w/o BM252022.12 | 1 | |
| T5 3B#Params=8.5x, Language Mode=English-only, Retrieval=w/o BM252022.12 | 0.5 | |
| OPT 6.7B#Params=19x, Language Mode=English-only, Retrieval=w/o BM252022.12 | 0.4 | |
| T5#Params=2.2x, Language Mode=English-only, Retrieval=w/o BM252022.12 | 0.2 | |
| BLOOM 7.1B#Params=20x, #L=46, Language Mode=Multilingual, Retrieval=w/o BM252022.12 | 0.1 | |
| BLOOM 3B#Params=8.5x, #L=46, Language Mode=Multilingual, Retrieval=w/o BM252022.12 | 0 |