List your company
ResearchFormerly WizWand

Data Unit Test Generation on EIDBench

715Passed CountprismaDV
-7.8179.85367.5555.15Apr 23, 2026
Updated 6mo ago

Evaluation results

MethodLinks
prismaDVBackbone LLM=gpt-5, Exec.=44.5, Non-exec.=0.02026.0471511236830570.586.677.4
prismaDVBackbone LLM=gemini-2.5-pro, Exec.=28.5, Non-exec.=0.02026.0459723047819576.17373.9
prismaDVBackbone LLM=gpt-5-mini, Exec.=42.9, Non-exec.=0.02026.045602674841897668.971.7
prismaDVBackbone LLM=gemini-2.5-flash, Exec.=36.4, Non-exec.=0.02026.0455127653314081.76772.9
prismaDVBackbone LLM=gpt-4.1, Exec.=34.1, Non-exec.=0.02026.0448434355112281.657.867
tensorflow-dv2026.0435247545621765.142.750.3
few-shotBackbone LLM=gemini-2.5-pro, Exec.=9.6, Non-exec.=1.12026.0423059756610769.926.843
few-shotBackbone LLM=gpt-5-mini, Exec.=18.8, Non-exec.=3.02026.0421561257010367.125.251.3
zero-shotBackbone LLM=gemini-2.5-pro, Exec.=12.4, Non-exec.=2.82026.04203624595786522.831
few-shotBackbone LLM=gpt-5, Exec.=25.8, Non-exec.=2.02026.041916366145975.821.447.2
swe-agentBackbone LLM=gpt-5, Exec.=24.1, Non-exec.=1.72026.041796486225178.620.347.2
zero-shotBackbone LLM=gpt-5-mini, Exec.=17.1, Non-exec.=4.72026.041646635848965.72030.4
few-shotBackbone LLM=gpt-4.1, Exec.=23.2, Non-exec.=3.62026.041526756136066.818.540.4
deequExec.=67.0, Non-exec.=0.02026.0413469356011365.814.424.2
few-shotBackbone LLM=gemini-2.5-flash, Exec.=33.8, Non-exec.=9.82026.041316966155865.815.235.5
zero-shotBackbone LLM=gpt-4.1, Exec.=26.1, Non-exec.=4.62026.04100727594795112.718.7
zero-shotBackbone LLM=gpt-5, Exec.=34.1, Non-exec.=3.52026.04757526611280.38.731.9
zero-shotBackbone LLM=gemini-2.5-flash, Exec.=48.3, Non-exec.=20.32026.0420807668581.92.411