List your company
ResearchFormerly WizWand

Retrieval-Augmented Code Generation on CSN-Python Non-target Queries (test)

0.318Similarity (GPT-4o)VenomRACG
0.196320.227910.25950.29109Dec 25, 2025
Updated 8mo ago

Evaluation results

MethodLinks
VenomRACGSetting=Black-box, Target=given (7.77%)2025.120.3180.487
BadCodeSetting=Black-box, Target=given (7.77%)2025.120.3150.528
DeadCodeSetting=White-box, Target=get (7.99%)2025.120.3140.496
DeadCodeSetting=White-box, Target=given (7.77%)2025.120.3120.507
VenomRACGSetting=White-box, Target=given (7.77%)2025.120.3120.489
VenomRACGSetting=White-box, Target=get (7.99%)2025.120.3120.502
DeadCodeSetting=Black-box, Target=get (7.99%)2025.120.3090.488
BadCodeSetting=White-box, Target=get (7.99%)2025.120.3080.512
DeadCodeSetting=Black-box, Target=given (7.77%)2025.120.3070.519
BadCodeSetting=Black-box, Target=get (7.99%)2025.120.3060.514
VenomRACGSetting=Black-box, Target=get (7.99%)2025.120.3050.5
BadCodeSetting=White-box, Target=given (7.77%)2025.120.2980.524
VenomRACGSetting=White-box, Target=file (6.28%)2025.120.2970.433
VenomRACGSetting=Black-box, Target=file (6.28%)2025.120.2930.432
No AttackSetting=No Poisoned, Target=N/A2025.120.2760.462
DeadCodeSetting=Black-box, Target=file (6.28%)2025.120.2120.447
DeadCodeSetting=White-box, Target=file (6.28%)2025.120.2110.443
BadCodeSetting=White-box, Target=file (6.28%)2025.120.2050.406
BadCodeSetting=Black-box, Target=file (6.28%)2025.120.2010.408