List your company

Web Agent Task Success on WebArena Gitlab 180 tasks

46.7Task Success Rate (SR)ReasoningBank + MaTTS
33.38836.84440.343.756Sep 29, 2025

Evaluation results

MethodLinks
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-pro2025.0946.79.1
ReasoningBankBackbone LLM=Gemini-2.5-pro2025.0944.49.8
ReasoningBank + MaTTSBackbone LLM=Claude-3.7-sonnet2025.0943.39.4
ReasoningBank + MaTTSBackbone LLM=Gemini-2.5-flash2025.0942.811.9
ReasoningBankBackbone LLM=Claude-3.7-sonnet2025.0941.19.5
ReasoningBankBackbone LLM=Gemini-2.5-flash2025.0940.612.3
AWMBackbone LLM=Gemini-2.5-pro2025.094011.2
SynapseBackbone LLM=Gemini-2.5-pro2025.0938.311.3
SynapseBackbone LLM=Claude-3.7-sonnet2025.093810
AWMBackbone LLM=Gemini-2.5-flash2025.0937.213.2
No MemoryBackbone LLM=Claude-3.7-sonnet2025.0936.710.6
SynapseBackbone LLM=Gemini-2.5-flash2025.0935.613
No MemoryBackbone LLM=Gemini-2.5-pro2025.093511.6
AWMBackbone LLM=Claude-3.7-sonnet2025.0934.610.9
No MemoryBackbone LLM=Gemini-2.5-flash2025.0933.913.3