ResearchBenchmarksLanguage Understanding on MMMLU German (5-shot, test)Follow61.8Normalized Log AccuracyT-Free57.53658.64359.7560.857Mar 16, 2026Evaluation ResultsMethodMethodLinksNormalized Log AccuracyBytes per Sequence PositionT-Freeshots=5-shot, evaluati...shots=5-shot, evaluation_mode=Pre-training2026.0361.86.03HATifiedshots=5-shot, evaluati...shots=5-shot, evaluation_mode=Pre-training2026.0358.86.03Llamashots=5-shot, evaluati...shots=5-shot, evaluation_mode=Pre-training2026.0357.73.33