Software Engineering Question Answering on SWE-QA Reflex
8.15Overall ScoreLaMR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LaMRBackbone=Claude Opus 4.62026.05 | 8.15 | 27.4 | 661.9 | |
| SWE-PrunerBackbone=Claude Opus 4.62026.05 | 8.14 | 30.7 | 737 | |
| SWE-PrunerBackbone=Claude Sonnet 4.52026.05 | 8.07 | 32.4 | 901.5 | |
| UnprunedBackbone=Claude Opus 4.62026.05 | 8.06 | 26.9 | 677 | |
| LaMRBackbone=Claude Sonnet 4.52026.05 | 7.88 | 29.2 | 753.2 | |
| UnprunedBackbone=Claude Sonnet 4.52026.05 | 7.75 | 33.2 | 1,096.3 |