ResearchBenchmarksSynthetic Tasks on LongBench Synthetic TasksFollow67.78Accuracybaseline44.109650.254856.462.5452Mar 25, 2025Evaluation ResultsMethodMethodLinksAccuracybaselinePrecision=16-bit, Back...Precision=16-bit, Backbone=Llama3.1-8B2025.0367.78KiViPrecision=4-bit, Backb...Precision=4-bit, Backbone=Llama3.1-8B2025.0367.74LogQuantPrecision=4-bit, Backb...Precision=4-bit, Backbone=Llama3.1-8B2025.0367.68LogQuantPrecision=2-bit, Backb...Precision=2-bit, Backbone=Llama3.1-8B2025.0352.51KiViPrecision=2-bit, Backb...Precision=2-bit, Backbone=Llama3.1-8B2025.0345.02