List your company
ResearchFormerly WizWand

Coding Reasoning on MBPP

80Knowledge RecallCorDA
50.8858.446673.56May 23, 2026
Updated 5mo ago

Evaluation results

MethodLinks
CorDABackbone=Mistral-7B, # Facts=1002026.058049.49
CorDABackbone=Mistral-7B, # Facts=10002026.0577.942.42
CorDABackbone=Mistral-7B, # Facts=2502026.0574.445.45
CorDABackbone=Mistral-7B, # Facts=5002026.0572.642.42
PALoRABackbone=Mistral-7B, # Facts=1002026.056747.47
LoRABackbone=Mistral-7B, # Facts=2502026.0566.848.48
PALoRABackbone=Mistral-7B, # Facts=2502026.056448.48
LoRABackbone=Mistral-7B, # Facts=10002026.0563.951.52
PALoRABackbone=Mistral-7B, # Facts=5002026.0563.646.46
LoRABackbone=Mistral-7B, # Facts=1002026.056348.48
LoRABackbone=Mistral-7B, # Facts=5002026.056344.44
PALoRABackbone=Mistral-7B, # Facts=10002026.0562.249.49
OPLoRABackbone=Mistral-7B, # Facts=2502026.0558.447.47
OPLoRABackbone=Mistral-7B, # Facts=1002026.055848.48
OPLoRABackbone=Mistral-7B, # Facts=10002026.0552.747.47
OPLoRABackbone=Mistral-7B, # Facts=5002026.055244.44