List your company

Web Agent Task Success on WebArena Overall 684 tasks

56.3Task Success Rate (SR)ReasoningBank + MaTTS
39.86844.13448.452.666Sep 29, 2025

Evaluation results

MethodLinks
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-pro2025.0956.37.1
ReasoningBankBackbone LLM=Gemini-2.5-pro2025.0953.97.4
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-flash2025.0951.87.9
ReasoningBankBackbone LLM=Gemini-2.5-flash2025.0948.88.3
ReasoningBank + MaTTSBackbone LLM=Claude-3.7-sonnet2025.0948.87.2
SynapseBackbone LLM=Gemini-2.5-pro2025.0947.78.5
AWMBackbone LLM=Gemini-2.5-pro2025.0947.68.7
No MemoryBackbone LLM=Gemini-2.5-pro2025.0946.78.8
ReasoningBankBackbone LLM=Claude-3.7-sonnet2025.0946.37.3
AWMBackbone LLM=Gemini-2.5-flash2025.0944.19
SynapseBackbone LLM=Claude-3.7-sonnet2025.0942.67.9
SynapseBackbone LLM=Gemini-2.5-flash2025.0942.19.2
No MemoryBackbone LLM=Claude-3.7-sonnet2025.0941.78
AWMBackbone LLM=Claude-3.7-sonnet2025.0940.88.9
No MemoryBackbone LLM=Gemini-2.5-flash2025.0940.59.7