List your company

Code Completion on LongBench

59.78Accuracybaseline
42.391246.905651.4255.9344Mar 25, 2025

Evaluation results

MethodLinks
baselinePrecision=16-bit, Backbone=Llama3.1-8B2025.0359.78
LogQuantPrecision=4-bit, Backbone=Llama3.1-8B2025.0359.57
KiViPrecision=4-bit, Backbone=Llama3.1-8B2025.0359.53
LogQuantPrecision=2-bit, Backbone=Llama3.1-8B2025.0352.1
KiViPrecision=2-bit, Backbone=Llama3.1-8B2025.0343.06