Agentic Task Completion on AppWorld normal Hard (test)
39.7AccuracyNo compression
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| No compressionAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=None2025.10 | 39.7 | 11.95 | 9.11 | |
| ACON UTCOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=Observation Compression2025.10 | 31.8 | 9.14 | 7.5 | |
| ACON UTCOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.10 | 30.2 | 7.44 | 6.55 | |
| ACON UTAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.10 | 28.6 | 7.65 | 6.37 | |
| PromptingAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=Observation Compression2025.10 | 27 | 7.79 | 6.07 | |
| ACON UTAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=Observation Compression2025.10 | 27 | 9.07 | 7.73 | |
| PromptingAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.10 | 23.8 | 7.31 | 7.48 | |
| FIFOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.10 | 15.9 | 7.14 | 7.8 | |
| LLMLinguaAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.10 | 15.9 | 8.09 | 8.59 | |
| LLMLinguaAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=Observation Compression2025.10 | 14.3 | 10.29 | 9.92 | |
| RetrievalAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.10 | 7.9 | 9.02 | 8.33 |