ResearchBenchmarksAI-assisted Programming on ConsistencyChecker Programming benchmarkFollow85.1Consistency ScoreQwen-2.559.41266.08172.7579.419Jun 14, 2025Evaluation ResultsMethodMethodLinksConsistency ScoreQwen-2.5Size=32BSize=32B2025.0685.1LLaMA-3.1Size=70BSize=70B2025.0683.5Qwen-2.5Size=14BSize=14B2025.0679.9Qwen-2.5Size=72BSize=72B2025.0677GPT-4o-mini2025.0676.5Qwen-2.5Size=7BSize=7B2025.0671.7Qwen-2.5Size=1.5BSize=1.5B2025.0663.4LLaMA-3.1Size=8BSize=8B2025.0660.4