Long-horizon LLM Agent performance on OfficeBench
76.84AccuracyNo Compression
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| No CompressionAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=None2025.10 | 76.84 | 11.52 | 7.27 | 4.43 | |
| ACON UTAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=History Compression2025.10 | 74.74 | 13.13 | 4.93 | 3.85 | |
| ACON UTAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=Observation Compression2025.10 | 73.68 | 10.83 | 6.55 | 3.85 | |
| ACON UTCOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=History Compression2025.10 | 72.63 | 11.54 | 4.54 | 1.91 | |
| ACON UTCOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=Observation Compression2025.10 | 72.63 | 10.28 | 6.17 | 2.88 | |
| PromptingAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=History Compression2025.10 | 71.58 | 10.13 | 4.4 | 1.1 | |
| LLMLinguaAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=Observation Compression2025.10 | 71.58 | 11.89 | 7.38 | 6.14 | |
| LLMLinguaAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=History Compression2025.10 | 70.53 | 10.89 | 4.65 | 1.85 | |
| FIFOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=History Compression2025.10 | 67.37 | 12.26 | 4.02 | 2.64 | |
| RetrievalAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=History Compression2025.10 | 65.26 | 16.2 | 4.33 | 2.06 | |
| PromptingAgent=gpt-4.1, Compressor=gpt-4.1, Compression Category=Observation Compression2025.10 | 55.79 | 12.24 | 6.44 | 2.68 |