ResearchBenchmarksHuman-Agent Interaction Assessment on Software Agent Case Study Claude-3.7 vs. Claude-4Follow0.053Effect Size∆naive0.030120.036060.0420.04794Oct 10, 2025Evaluation ResultsMethodMethodLinksEffect SizeEffect Size CI LowerEffect Size CI UpperSignificance (p-value)∆naiveCondition=naiveCondition=naive2025.100.053-0.0030.109—∆augmentCondition=augmentCondition=augment2025.100.050.020.081—∆naiveCondition=naiveCondition=naive2025.100.039-0.040.118—∆augmentCondition=augmentCondition=augment2025.100.0310.0140.049—