Software Engineering Question Answering on SWE-QA Streamlink
8.74ScoreUnpruned
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| UnprunedBackbone=Claude Opus 4.62026.05 | 8.74 | 17.4 | 394.4 | |
| LaMRBackbone=Claude Opus 4.62026.05 | 8.68 | 18.5 | 353.2 | |
| SWE-PrunerBackbone=Claude Opus 4.62026.05 | 8.6 | 19 | 398.6 | |
| SWE-PrunerBackbone=Claude Sonnet 4.52026.05 | 8.59 | 23.9 | 587.1 | |
| LaMRBackbone=Claude Sonnet 4.52026.05 | 8.53 | 16.3 | 467.7 | |
| UnprunedBackbone=Claude Sonnet 4.52026.05 | 8.44 | 23.4 | 629.3 |