List your company

Code Generation on MBPP (pass@16)

53.7pass@16 (MBPP)DS-MTP
-1.4647212.8568927.178541.50011Oct 16, 2025

Evaluation results

MethodLinks
DS-MTPModel Size=3B2025.1053.7
MTPModel Size=3B2025.1052.6
FSP-RevLMModel Size=3B2025.1052.4
NTPModel Size=3B2025.1052.1
FSP-RevLMScale=8B2025.100.683
DS-MTPScale=8B2025.100.678
MTPScale=8B2025.100.672
NTPScale=8B2025.100.657