List your company

Synthetic Tasks on LongBench Synthetic Tasks

67.78Accuracybaseline
44.109650.254856.462.5452Mar 25, 2025

Evaluation results

MethodLinks
baselinePrecision=16-bit, Backbone=Llama3.1-8B2025.0367.78
KiViPrecision=4-bit, Backbone=Llama3.1-8B2025.0367.74
LogQuantPrecision=4-bit, Backbone=Llama3.1-8B2025.0367.68
LogQuantPrecision=2-bit, Backbone=Llama3.1-8B2025.0352.51
KiViPrecision=2-bit, Backbone=Llama3.1-8B2025.0345.02