List your company

Web Agent Task Success on WebArena Reddit 106 tasks

83Success Rate (SR)ReasoningBank + MaTTS
51.59259.74667.976.054Sep 29, 2025

Evaluation results

MethodLinks
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-pro2025.09835.3
ReasoningBankBackbone LLM=Gemini-2.5-pro2025.0980.25.1
No MemoryBackbone LLM=Gemini-2.5-pro2025.0971.76
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-flash2025.0970.85.4
SynapseBackbone LLM=Gemini-2.5-pro2025.0968.95.9
AWMBackbone LLM=Gemini-2.5-pro2025.0968.96.4
ReasoningBankBackbone LLM=Gemini-2.5-flash2025.09675.6
AWMBackbone LLM=Gemini-2.5-flash2025.0962.36.1
ReasoningBank + MaTTSBackbone LLM=Claude-3.7-sonnet2025.0960.45
SynapseBackbone LLM=Gemini-2.5-flash2025.0959.46.5
ReasoningBankBackbone LLM=Claude-3.7-sonnet2025.0957.55.2
No MemoryBackbone LLM=Gemini-2.5-flash2025.0955.76.7
No MemoryBackbone LLM=Claude-3.7-sonnet2025.0953.85.5
SynapseBackbone LLM=Claude-3.7-sonnet2025.0953.86.1
AWMBackbone LLM=Claude-3.7-sonnet2025.0952.87