List your company
ResearchFormerly WizWand

Code Generation on xCodeEval

81.13Pass@1GEPA
-3.0881618.7761740.640562.50483May 18, 2024Aug 19, 2024Nov 21, 2024Feb 23, 2025May 27, 2025Aug 29, 2025Dec 1, 2025
Updated 8mo ago

Evaluation results

MethodLinks
GEPASource Model=GPT-4o, Target Model=o4-mini2025.1281.13
PromptBridgeSource Model=GPT-4o, Target Model=o4-mini2025.1277.67
PromptBridgeSource Model=GPT-4o, Target Model=o32025.1274.84
MIPROv2Source Model=GPT-4o, Target Model=o4-mini2025.1274.84
GPT-5 OptimizerSource Model=GPT-4o, Target Model=o4-mini2025.1274.53
GPT-5 OptimizerSource Model=GPT-4o, Target Model=o32025.1272.64
Direct TransferSource Model=GPT-4o, Target Model=o4-mini2025.1272.01
GEPASource Model=GPT-4o, Target Model=o32025.1269.49
Direct TransferSource Model=GPT-4o, Target Model=o32025.1266.04
MIPROv2Source Model=GPT-4o, Target Model=o32025.1265.09
GPT-4oModel Role=Source Model2025.1237.03
GPT-4oSource Model=GPT-4o, Evaluation Context=Source Performance Reference2025.1237.03
GPT-5 OptimizerSource Model=GPT-4o, Target Model=Gemma3-27B-it2025.1224.8
PromptBridgeSource Model=GPT-4o, Target Model=Llama3.1-70B-Instruct2025.1224.53
GPT-5 OptimizerSource Model=GPT-4o, Target Model=Llama3.1-70B-Instruct2025.1223.58
PromptBridgeSource Model=GPT-4o, Target Model=Gemma3-27B-it2025.1223.58
Direct TransferSource Model=GPT-4o, Target Model=Gemma3-27B-it2025.1222.64
GEPASource Model=GPT-4o, Target Model=Llama3.1-70B-Instruct2025.1222.01
PromptBridgeSource Model=GPT-4o, Target Model=Qwen3-32B2025.1221.7
Direct TransferSource Model=GPT-4o, Target Model=Llama3.1-70B-Instruct2025.1221.38
GPT-5 OptimizerSource Model=GPT-4o, Target Model=Qwen3-32B2025.1219.5
MIPROv2Source Model=GPT-4o, Target Model=Llama3.1-70B-Instruct2025.1218.87
Direct TransferSource Model=GPT-4o, Target Model=Qwen3-32B2025.1217.61
GPT-5 OptimizerSource Model=GPT-4o, Target Model=Llama3.1-8B-Instruct2025.1211.32
PromptBridgeSource Model=GPT-4o, Target Model=Llama3.1-8B-Instruct2025.129.43
Direct TransferSource Model=GPT-4o, Target Model=Llama3.1-8B-Instruct2025.126.6
MapCoderLLM=GPT-42024.050.453
CoTLLM=GPT-42024.050.368
Self-PlanningLLM=GPT-42024.050.34
DirectLLM=GPT-42024.050.321
MapCoderLLM=ChatGPT2024.050.274
AnalogicalLLM=GPT-42024.050.264
CoTLLM=ChatGPT2024.050.236
Self-PlanningLLM=ChatGPT2024.050.189
DirectLLM=ChatGPT2024.050.179
AnalogicalLLM=ChatGPT2024.050.151