ResearchBenchmarksRetrieval on STARK-AMAZON 1.0 (leave-out set of human-generated queries)Retrieval on STARK-AMAZON 1.0 (leave-out set of human-generated queries)Follow58.32Hit@1AVATAR14.359225.772137.18548.5979Jun 17, 2024Evaluation resultsMethodMethodLinksHit@1Hit@5R@20MRRAVATAR2024.0658.3276.5442.4365.91Reflexion2024.0649.3864.1935.9558.96multi-ada-0022024.0646.9172.8440.2258.74ReAct2024.0645.6571.7335.9558.81ada-0022024.0639.564.1935.4652.65DPRBackbone=robertaBackbone=roberta2024.0616.0539.5115.2327.21