MemoryArena
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MemoryArena Physics
11.63Success Metric
20
MemoryArena Math
10.88Success Score
20
MemoryArena
68Bundled Web Shop PS
14
MemoryArena Bundled Web Shopping
34.67Success Rate (SR)
8
MemoryArena Formal Reasoning 1.0 (test)
45Math Success Rate
8
MemoryArena Progressive Web Search 1.0 (test)
56.56Success Rate
8
MemoryArena Group Travel Planning 1.0 (test)
15.19Success Rate (SR)
8
MemoryArena Bundled Web Shopping 1.0 (test)
39.33Success Rate
8
MemoryArena Bundled Web Shopping
34.67Success Rate (SR)
4