List your company

Web Agent Task Success on WebArena 182 tasks (Admin)

58.2Success Rate (SR)ReasoningBank + MaTTS
43.95247.65151.3555.049Sep 29, 2025

Evaluation results

MethodLinks
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-pro2025.0958.27.4
ReasoningBankBackbone LLM=Gemini-2.5-pro2025.0956.67.7
ReasoningBank + MaTTSBackbone LLM=Claude-3.7-sonnet2025.0955.57.4
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-flash2025.0953.87.6
ReasoningBankBackbone LLM=Claude-3.7-sonnet2025.0953.37.6
SynapseBackbone LLM=Gemini-2.5-pro2025.0952.28.9
ReasoningBankBackbone LLM=Gemini-2.5-flash2025.0951.18.2
No MemoryBackbone LLM=Gemini-2.5-pro2025.0951.18.7
SynapseBackbone LLM=Claude-3.7-sonnet2025.0950.58.5
No MemoryBackbone LLM=Claude-3.7-sonnet2025.0949.58.4
AWMBackbone LLM=Gemini-2.5-pro2025.0949.39.8
AWMBackbone LLM=Claude-3.7-sonnet2025.0947.89.3
AWMBackbone LLM=Gemini-2.5-flash2025.0946.78.8
SynapseBackbone LLM=Gemini-2.5-flash2025.0945.19.1
No MemoryBackbone LLM=Gemini-2.5-flash2025.0944.59.5