MemoryBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MemoryBench Long-Input-Long-Output
64.23Norm-Score
24
MemoryBench Short-Input-Short-Output
76.26Norm-Score
24
MemoryBench Short-Input-Long-Output 1.0
77.09Norm-Score
24
MemoryBench Long-Input-Short-Output
52.6Norm-Score
22
MemoryBench (test)
100Success Rate
7
MemoryBench extended
93Put Block Back
4
MemoryBench
94.3Avg Success Rate
3