Next Token Prediction on Observed Antibody Sequences (OAS) processed subset
1.62Bits Per DimensionMistral 94M
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mistral 94MArchitecture=Mistral 7B (scaled-down), Parameters=94M, Quantization=Post-training quantization2024.07 | 1.62 | 19.4 | 14.59 | 0.3 | |
| Mistral 212MArchitecture=Mistral 7B (scaled-down), Parameters=212M, Quantization=Post-training quantization2024.07 | 2.06 | 26.25 | 21.07 | 0.3 | |
| Mistral 377MArchitecture=Mistral 7B (scaled-down), Parameters=377M, Quantization=Post-training quantization2024.07 | 2.41 | 31.6 | 26.46 | 0.28 | |
| Random Guess2024.07 | 4.86 | 96.56 | 65.51 | 1.46 |