ResearchBenchmarksSummarization on LongBench SummarizationFollow18.08Accuracybaseline16.020816.555417.0917.6246Mar 25, 2025Evaluation ResultsMethodMethodLinksAccuracybaselinePrecision=16-bit, Back...Precision=16-bit, Backbone=Llama3.1-8B2025.0318.08KiViPrecision=4-bit, Backb...Precision=4-bit, Backbone=Llama3.1-8B2025.0317.94LogQuantPrecision=4-bit, Backb...Precision=4-bit, Backbone=Llama3.1-8B2025.0317.92LogQuantPrecision=2-bit, Backb...Precision=2-bit, Backbone=Llama3.1-8B2025.0316.62KiViPrecision=2-bit, Backb...Precision=2-bit, Backbone=Llama3.1-8B2025.0316.1