Paper Reproduction on RE-Bench Medium tier
100Success RateARA
Evaluation results
| Method | Links | |
|---|---|---|
| ARAReproduced Paper=stochastic-interpolants, Artifact Type=ARA2026.04 | 100 | |
| BaselineReproduced Paper=stochastic-interpolants, Artifact Type=Baseline2026.04 | 100 | |
| ARAReproduced Paper=bam, Artifact Type=ARA2026.04 | 97.1 | |
| BaselineReproduced Paper=bam, Artifact Type=Baseline2026.04 | 95.1 | |
| ARAReproduced Paper=pinn, Artifact Type=ARA2026.04 | 93.8 | |
| ARAReproduced Paper=all-in-one, Artifact Type=ARA2026.04 | 92 | |
| ARAReproduced Paper=mechanistic-und., Artifact Type=ARA2026.04 | 88.3 | |
| BaselineReproduced Paper=all-in-one, Artifact Type=Baseline2026.04 | 87.5 | |
| BaselineReproduced Paper=adaptive-pruning, Artifact Type=Baseline2026.04 | 83 | |
| ARAReproduced Paper=adaptive-pruning, Artifact Type=ARA2026.04 | 80 | |
| BaselineReproduced Paper=pinn, Artifact Type=Baseline2026.04 | 75 | |
| BaselineReproduced Paper=rice, Artifact Type=Baseline2026.04 | 73.9 | |
| ARAReproduced Paper=rice, Artifact Type=ARA2026.04 | 72.1 | |
| ARAReproduced Paper=Mean, Artifact Type=ARA2026.04 | 68.5 | |
| ARAReproduced Paper=sequential-neural, Artifact Type=ARA2026.04 | 68.3 | |
| BaselineReproduced Paper=self-expansion, Artifact Type=Baseline2026.04 | 65 | |
| BaselineReproduced Paper=Mean, Artifact Type=Baseline2026.04 | 62.9 | |
| ARAReproduced Paper=bbox, Artifact Type=ARA2026.04 | 59.5 | |
| BaselineReproduced Paper=ftrl, Artifact Type=Baseline2026.04 | 54.4 | |
| BaselineReproduced Paper=sequential-neural, Artifact Type=Baseline2026.04 | 53.5 | |
| BaselineReproduced Paper=bbox, Artifact Type=Baseline2026.04 | 52.7 | |
| BaselineReproduced Paper=test-time-model-adapt., Artifact Type=Baseline2026.04 | 50 | |
| ARAReproduced Paper=self-composing-pol., Artifact Type=ARA2026.04 | 46.5 | |
| ARAReproduced Paper=fre, Artifact Type=ARA2026.04 | 45.4 | |
| ARAReproduced Paper=test-time-model-adapt., Artifact Type=ARA2026.04 | 43.5 | |
| ARAReproduced Paper=ftrl, Artifact Type=ARA2026.04 | 38 | |
| ARAReproduced Paper=self-expansion, Artifact Type=ARA2026.04 | 37.5 | |
| BaselineReproduced Paper=mechanistic-und., Artifact Type=Baseline2026.04 | 36.7 | |
| BaselineReproduced Paper=self-composing-pol., Artifact Type=Baseline2026.04 | 36 | |
| BaselineReproduced Paper=sample-specific-masks, Artifact Type=Baseline2026.04 | 35.7 | |
| BaselineReproduced Paper=fre, Artifact Type=Baseline2026.04 | 32.6 | |
| ARAReproduced Paper=sample-specific-masks, Artifact Type=ARA2026.04 | 29.8 |