Automatic Speech Recognition on FLEURS (en, ko, ja, de, fr, hi, es, it, pt-br, ru, ar, zh)
6.5Error Rate (en)Gemma 4 E4B
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 E4BParams=305M, Size=87 MB, Task=transcription2026.07 | 6.5 | 5.3 | 7.8 | 6.1 | 8 | 8.6 | 3.5 | 3.2 | 4.6 | 6.8 | 16.2 | 13.6 | 7.5 | — | — | |
| Gemma 3n E4BParams=680M, Size=390 MB, Task=transcription2026.07 | 6.6 | 7.3 | 11.1 | 6.5 | 9.8 | 8.9 | 4.1 | 3.4 | 5.3 | 8.7 | 10.1 | 20.3 | 8.5 | — | — | |
| Gemma 3n E2BParams=680M, Size=390 MB, Task=transcription2026.07 | 7.6 | 10.1 | 16.3 | 7.9 | 13 | 10.6 | 5.1 | 4.4 | 6.7 | 11.2 | 13.1 | 23.5 | 10.8 | — | — | |
| Gemma 4 E2BParams=305M, Size=87 MB, Task=transcription2026.07 | 8 | 6.6 | 10.7 | 7.6 | 10.1 | 10.1 | 4.2 | 4.1 | 5.6 | 8.4 | 14.3 | 18.7 | 9 | — | — |