Wrong Result (WR) Detection on Vyper
10FPRSol2Vy
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Sol2VyMethod Category=Our Approach2026.03 | 10 | 15 | |
| Sol2VyEvaluation Scenario=Train on Solidity & Test on Vyper2026.03 | 12 | 14 | |
| Vyper-trained Classification NetworkMethod Category=Deep Learning-based, Evaluation Setting=Train & Test on Vyper2026.03 | 29 | 35 | |
| CodeT5+Method Category=Deep Learning-based, Evaluation Setting=Train & Test on Vyper2026.03 | 32 | 38 | |
| GraphCodeBERTMethod Category=Deep Learning-based, Evaluation Setting=Train & Test on Vyper2026.03 | 35 | 42 | |
| MythrilMethod Category=Program Analysis-based2026.03 | 40 | 46 | |
| Qwen-Coder-7bMethod Category=LLM-based Methods, Evaluation Setting=Direct Prompting2026.03 | 42 | 54 | |
| GPT-4.1Method Category=LLM-based Methods, Evaluation Setting=Direct Prompting2026.03 | 44 | 56 | |
| CodeLlama-7bMethod Category=LLM-based Methods, Evaluation Setting=Direct Prompting2026.03 | 47 | 59 | |
| SlitherMethod Category=Program Analysis-based2026.03 | 48 | 55 | |
| Sol2Vy w/o freezingMethod Category=Joint Training Baseline2026.03 | 68 | 78 |