Software Engineering Question Answering on SWE-QA Conan
8.71ScoreLaMR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LaMRBackbone=Claude Opus 4.62026.05 | 8.71 | 15.1 | 325.9 | |
| UnprunedBackbone=Claude Opus 4.62026.05 | 8.68 | 16.2 | 301.9 | |
| SWE-PrunerBackbone=Claude Opus 4.62026.05 | 8.61 | 18.6 | 368 | |
| LaMRBackbone=Claude Sonnet 4.52026.05 | 8.48 | 18.8 | 535.2 | |
| SWE-PrunerBackbone=Claude Sonnet 4.52026.05 | 8.37 | 23.5 | 551.7 | |
| UnprunedBackbone=Claude Sonnet 4.52026.05 | 8.35 | 23.9 | 672.9 |