Code Generation on HumanEval (Accuracy, TPS)
60.98AccuracyFDM-A
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FDM-ALLDM Model=LLaDA-MoE2025.12 | 60.98 | 11.25 | |
| EBLLDM Model=LLaDA-MoE2025.12 | 59.15 | 10.14 | |
| WINOLLDM Model=LLaDA-MoE2025.12 | 56.71 | 9.31 | |
| ProbabilityLLDM Model=LLaDA-MoE, Threshold (T)=1282025.12 | 51.22 | 7.99 | |
| MarginLLDM Model=LLaDA-MoE, Threshold (T)=1282025.12 | 49.39 | 7.74 | |
| EntropyLLDM Model=LLaDA-MoE, Threshold (T)=1282025.12 | 48.78 | 7.46 | |
| FDM-ALLDM Model=LLaDA2025.12 | 44.51 | 21.56 | |
| FDM-ALLDM Model=LLaDA-1.52025.12 | 42.07 | 23.83 | |
| WINOLLDM Model=LLaDA-1.52025.12 | 40.24 | 20.59 | |
| ProbabilityLLDM Model=LLaDA-1.5, Threshold (T)=1282025.12 | 39.63 | 17.04 | |
| WINOLLDM Model=LLaDA2025.12 | 39.02 | 18.33 | |
| EBLLDM Model=LLaDA-1.52025.12 | 37.8 | 18.99 | |
| MarginLLDM Model=LLaDA, Threshold (T)=1282025.12 | 37.2 | 16.25 | |
| EBLLDM Model=LLaDA2025.12 | 37.2 | 17.34 | |
| MarginLLDM Model=LLaDA-1.5, Threshold (T)=1282025.12 | 37.2 | 16.58 | |
| ProbabilityLLDM Model=LLaDA, Threshold (T)=1282025.12 | 35.37 | 16.75 | |
| EntropyLLDM Model=LLaDA-1.5, Threshold (T)=1282025.12 | 35.37 | 15.77 | |
| EntropyLLDM Model=LLaDA, Threshold (T)=1282025.12 | 31.2 | 15.93 | |
| FDM-ALLDM Model=MMaDA-MixCoT2025.12 | 13.41 | 32.32 | |
| MarginLLDM Model=MMaDA-MixCoT, Threshold (T)=1282025.12 | 12.8 | 16.15 | |
| EBLLDM Model=MMaDA-MixCoT2025.12 | 12.8 | 24.95 | |
| WINOLLDM Model=MMaDA-MixCoT2025.12 | 12.2 | 29.9 | |
| ProbabilityLLDM Model=MMaDA-MixCoT, Threshold (T)=1282025.12 | 7.93 | 16.59 | |
| EntropyLLDM Model=MMaDA-MixCoT, Threshold (T)=1282025.12 | 4.27 | 15.46 |