Multilingual Language Evaluation on Non-English lm-evaluation-harness
25.71C-EvalTransformer + Spelling Bee Embeddings
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Transformer + Spelling Bee EmbeddingsTotal parameters=918m, Non-embedding parameters=764m, n-shot=02026.01 | 25.71 | 29.83 | |
| TransformerTotal parameters=918m, Non-embedding parameters=764m, n-shot=02026.01 | 23.03 | 13.05 |