List your company
ResearchFormerly WizWand

Agentic Task Completion on AppWorld Easy normal (test)

86AccuracyACON UTCO
53.13661.66870.278.732Oct 1, 2025
Updated 5mo ago

Evaluation results

MethodLinks
ACON UTCOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.10867.092.84
FIFOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.1084.25.852.89
ACON UTCOAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=Observation Compression2025.1082.55.662.63
No compressionAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=None2025.1080.77.572.98
ACON UTAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.1077.26.452.43
ACON UTAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=Observation Compression2025.1070.25.872.21
LLMLinguaAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.1066.76.383.04
PromptingAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.1066.76.362.84
PromptingAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=Observation Compression2025.1064.94.921.88
RetrievalAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=History Compression2025.1061.47.43.97
LLMLinguaAgent=gpt-4.1, Compressor=gpt-4.1, Compression Type=Observation Compression2025.1054.45.782.33