List your company

Ranking Preservation on SWE-bench Mini (test)

0.922Mean Spearman RhoEasiest
0.879360.890430.90150.91257Mar 24, 2026

Evaluation results

MethodLinks
Easiestk=20, Selection strategy=Easiest, Evaluation protocol=mean across all protocols2026.030.922———
MRk=20, Selection strategy=Mid-Range, Evaluation protocol=mean across all protocols2026.030.92———
Randomk=20, Selection strategy=Random, Evaluation protocol=mean across all protocols2026.030.9030.0260.6950.977
Stratifiedk=20, Selection strategy=Stratified, Evaluation protocol=mean across all protocols2026.030.902———
Greedyk=20, Selection strategy=Greedy, Evaluation protocol=mean across all protocols2026.030.881———