List your company
ResearchFormerly WizWand

Coding Tasks on MBPP+ instruct latest (test)

75.4AccuracyFP16
21.94435.82249.763.578Dec 3, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FP16W-bit=16, Prun. %=0%, R.size (×)=0×, Backbone=Llama-3.1-8B-Instruct2025.1275.4
UniQLOne-pass=true, +FT=true, W-bit=4, Prun. %=0%, R.size (×)=4×, Backbone=Llama-3.1-8B-Instruct2025.1264.8
UniQLOne-pass=true, +FT=true, W-bit=4, Prun. %=15%, R.size (×)=4.7×, Backbone=Llama-3.1-8B-Instruct2025.1254.2
MoDeGPTOne-pass=false, +FT=false, W-bit=16, Prun. %=15%, R.size (×)=0.15×, Backbone=Llama-3.1-8B-Instruct2025.1242.3
UniQLOne-pass=true, +FT=true, W-bit=4, Prun. %=25%, R.size (×)=5.3×, Backbone=Llama-3.1-8B-Instruct2025.1233.8
SVD-LLMOne-pass=false, +FT=true, W-bit=4, Prun. %=15%, R.size (×)=4.7×, Backbone=Llama-3.1-8B-Instruct2025.1224