List your company
ResearchFormerly WizWand

Interactive Database Interaction on BIRD-Interact Phase 2

34.3Success Rate (WRITE)MERIT
11.180817.182923.18529.1871May 30, 2026
Updated 5mo ago

Evaluation results

MethodLinks
MERITMemory Strategy=Dynamic Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0534.317.2222.17
MemRLMemory Strategy=Dynamic Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0530.4614.0818.83
BM25Memory Strategy=Static Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0528.7413.8518.17
Cosine SimilarityMemory Strategy=Static Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0528.7413.6218
MementoMemory Strategy=Dynamic Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0528.7413.3817.83
DemoMemory Strategy=No Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0528.1611.9716.67
TopicKMemory Strategy=Static Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0525.8611.9716
No MemoryMemory Strategy=No Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0520.1110.3313.17
Vanilla GPT-5Memory Strategy=No Memory, Backbone=GPT-5, User Simulator=GPT-4o2026.0512.073.055.67