List your company

Constraint discovery from data-code pairs on ICDBench

61Passed RateprismaDV
-2.4414.0330.546.97Apr 23, 2026

Evaluation results

MethodLinks
prismaDVLLM=gpt-5, Task-aware?=true, Generates test?=true, Avg. num. const.=2.62026.0461248151787.8
prismaDVLLM=gpt-5-mini, Task-aware?=true, Generates test?=true, Avg. num. const.=2.52026.0460346172085.7
prismaDVLLM=gemini-2.5-flash, Task-aware?=true, Generates test?=true, Avg. num. const.=2.12026.0459440232781.4
prismaDVLLM=gemini-2.5-pro, Task-aware?=true, Generates test?=true, Avg. num. const.=1.72026.0459442212582.5
prismaDVLLM=gpt-4.1, Task-aware?=true, Generates test?=true, Avg. num. const.=2.12026.0456638253177.8
deequTask-aware?=false, Generates test?=true, Avg. num. const.=1.92026.04441927365561.5
pocketflow-agentTask-aware?=true, Generates test?=true, Avg. num. const.=2.22026.04382532315657.6
few-shotLLM=gpt-5, Task-aware?=true, Generates test?=true, Avg. num. const.=2.52026.0436275493666.7
swe-agentTask-aware?=true, Generates test?=true, Avg. num. const.=2.22026.0435285493765.4
few-shotLLM=gemini-2.5-pro, Task-aware?=true, Generates test?=true, Avg. num. const.=1.92026.0434295493864.2
few-shotLLM=gpt-5-mini, Task-aware?=true, Generates test?=true, Avg. num. const.=2.42026.0433305943766
tensorflow-dvTask-aware?=false, Generates test?=true2026.04323132316250.8
zero-shotLLM=gpt-5-mini, Task-aware?=true, Generates test?=true, Avg. num. const.=3.52026.0430335763960.6
zero-shotLLM=gpt-5, Task-aware?=true, Generates test?=true, Avg. num. const.=3.12026.0430335763960.6
few-shotLLM=gpt-4.1, Task-aware?=true, Generates test?=true, Avg. num. const.=2.12026.04293452114556.3
few-shotLLM=gemini-2.5-flash, Task-aware?=true, Generates test?=true, Avg. num. const.=2.02026.04273651124852.9
zero-shotLLM=gemini-2.5-flash, Task-aware?=true, Generates test?=true, Avg. num. const.=2.42026.0422415944549.4
zero-shotLLM=gemini-2.5-pro, Task-aware?=true, Generates test?=true, Avg. num. const.=2.82026.0419446034744.7
zero-shotLLM=gpt-4.1, Task-aware?=true, Generates test?=true, Avg. num. const.=3.12026.0419445675142.7
isolation-forestTask-aware?=false, Generates test?=false2026.04144951126131.5
one-class-svmTask-aware?=false, Generates test?=false2026.04063612650
stats-noveltyTask-aware?=false, Generates test?=false2026.04063630630