List your company

Web Agent Task Success on WebArena Multi 29 tasks

20.7Task Success Rate (SR)ReasoningBank + MaTTS
-0.8284.76110.3515.939Sep 29, 2025

Evaluation results

MethodLinks
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-pro2025.0920.77.2
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-flash2025.0917.28
ReasoningBankBackbone LLM=Gemini-2.5-flash2025.0913.88.8
ReasoningBankBackbone LLM=Gemini-2.5-pro2025.0913.88.2
No MemoryBackbone LLM=Gemini-2.5-flash2025.0910.310
SynapseBackbone LLM=Gemini-2.5-flash2025.0910.310.5
ReasoningBank + MaTTSBackbone LLM=Claude-3.7-sonnet2025.0910.39.1
No MemoryBackbone LLM=Gemini-2.5-pro2025.096.98.8
SynapseBackbone LLM=Gemini-2.5-pro2025.096.99
AWMBackbone LLM=Gemini-2.5-flash2025.093.47.7
AWMBackbone LLM=Gemini-2.5-pro2025.093.49.3
ReasoningBankBackbone LLM=Claude-3.7-sonnet2025.093.410.5
No MemoryBackbone LLM=Claude-3.7-sonnet2025.09011.6
SynapseBackbone LLM=Claude-3.7-sonnet2025.09011.8
AWMBackbone LLM=Claude-3.7-sonnet2025.09012.4