List your company
ResearchFormerly WizWand

Code Generation on MBPP (MBPP Acc %)

59.8MBPP AccuracySVD
3.95218.45132.9547.449Jul 4, 2025
Updated 6mo ago

Evaluation results

MethodLinks
SVDModel Size (Billion)=6.742025.0759.8
FWSVDModel Size (Billion)=6.742025.0759.8
ASVDModel Size (Billion)=6.742025.0759.8
AFMModel Size (Billion)=6.742025.0759.8
IMPACTModel Size (Billion)=6.742025.0759.8
SVDModel Size (Billion)=6.142025.0754.8
FWSVDModel Size (Billion)=4.772025.0754.8
ASVDModel Size (Billion)=4.102025.0751.9
IMPACTModel Size (Billion)=3.582025.0751.6
IMPACTModel Size (Billion)=2.642025.0749.7
AFMModel Size (Billion)=3.762025.0749.5
AFMModel Size (Billion)=2.812025.0749.2
SVDModel Size (Billion)=3.132025.0746.8
ASVDModel Size (Billion)=3.432025.0744.7
FWSVDModel Size (Billion)=2.942025.0744.2
ASVDModel Size (Billion)=2.772025.0743.9
AFMModel Size (Billion)=2.042025.0743.1
IMPACTModel Size (Billion)=1.902025.0742.6
FWSVDModel Size (Billion)=2.192025.0736.2
SVDModel Size (Billion)=2.372025.0735.7
ASVDModel Size (Billion)=2.112025.0732.3
IMPACTModel Size (Billion)=1.302025.0728
AFMModel Size (Billion)=1.422025.0726.7
FWSVDModel Size (Billion)=1.542025.0723.8
SVDModel Size (Billion)=1.692025.0719.6
IMPACTModel Size (Billion)=0.842025.0716.4
ASVDModel Size (Billion)=1.452025.0716.1
AFMModel Size (Billion)=0.922025.0712.2
FWSVDModel Size (Billion)=0.962025.079.5
SVDModel Size (Billion)=1.092025.076.1