Regression Testing Cost Analysis on Regression Test Scenarios 3 scenarios
0CostFull
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FullModel=GPT-5.22026.03 | 0 | 100 | |
| FullModel=Sonnet 4.62026.03 | 0 | 100 | |
| FullModel=Mistral-L32026.03 | 0 | 100 | |
| Fixed-nModel=Llama-4-Maverick2026.03 | 0 | — | |
| SPRTModel=Llama-4-Maverick2026.03 | 0 | — | |
| FullModel=Llama-4-Maverick2026.03 | 0 | — | |
| SPRTModel=GPT-5.22026.03 | 0.028 | 78 | |
| SPRTModel=Sonnet 4.62026.03 | 0.043 | 78 | |
| SPRTModel=Mistral-L32026.03 | 0.076 | 77 | |
| Fixed-nModel=GPT-5.22026.03 | 0.127 | — | |
| Fixed-nModel=Sonnet 4.62026.03 | 0.196 | — | |
| Fixed-nModel=Mistral-L32026.03 | 0.338 | — |