ResearchBenchmarksWord Prediction on LambadaFollow43.7Compressed AccuracyLlama7.61216.98126.3535.719Mar 16, 2026Evaluation ResultsMethodMethodLinksCompressed AccuracyCompression RatioBytes per PositionLlamashots=5-shotshots=5-shot2026.0343.73.55—HATifiedshots=5-shotshots=5-shot2026.0337.95.78—HATifiedtraining=SFT, shots=5-...training=SFT, shots=5-shot2026.0336.8—5.79Tülushots=5-shotshots=5-shot2026.0320.13.55—Tülutraining=SFT, shots=5-...training=SFT, shots=5-shot2026.0317.8—3.55T-Freeshots=5-shotshots=5-shot2026.0395.79—