Task Goal Completion on AppWorld Hard 63 tasks (test_normal)
31.7AccuracyNo compression
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| No compression2026.06 | 31.7 | 11.95 | 0 | |
| FIFOstrategy=recency2026.06 | 17.5 | 6.58 | 0 | |
| LRE2026.06 | 14.3 | 7.79 | 0 | |
| ACONmode=in-fork2026.06 | 4.8 | 5.68 | 7.37 |