Deep Search on Deep Search Tasks (test) benchmark leaderboard · SOTA2 Research

Deep Search on Deep Search Tasks (test)

91.3Pass@1SALE w/o memory

Evaluation Results

Method	Links
SALE w/o memory2026.02		91.3	0.24
SALE2026.02		91.3	0.22
SALE2026.02		88.5	0.22
Best single agent2026.02		87.5	0.36
Best single agent2026.02		87.5	0.36
SALE w/o memory2026.02		87.5	0.24
TO-Router2026.02		86.3	0.28
FrugalGPT2026.02		86.3	0.47
WTP2026.02		86.3	0.33
CARROT2026.02		86.3	0.28
TO-Router2026.02		86.3	0.32
CARROT2026.02		85	0.27
WTP2026.02		83.8	0.32
FrugalGPT2026.02		81.3	0.48
SALE2026.02		73.5	0.23
SALE w/o memory2026.02		72.5	0.25
Best single agent2026.02		68.8	0.36
WTP2026.02		67.5	0.31
TO-Router2026.02		67.5	0.34
SALE2026.02		67.3	0.21
SALE w/o memory2026.02		66.4	0.24
CARROT2026.02		66.3	0.29
FrugalGPT2026.02		66.3	0.53
Best single agent2026.02		63.8	0.36
TO-Router2026.02		63	0.33
WTP2026.02		62.4	0.32
CARROT2026.02		61.3	0.28
FrugalGPT2026.02		61	0.51
SALE2026.02		37.1	0.17
SALE w/o memory2026.02		35.4	0.19
WTP2026.02		34.2	0.32
Best single agent2026.02		32.9	0.36
TO-Router2026.02		32.9	0.36
FrugalGPT2026.02		30.5	0.5
CARROT2026.02		29.3	0.29
SALE2026.02		16.3	0.23
SALE w/o memory2026.02		15.6	0.26
Best single agent2026.02		12.5	0.36
TO-Router2026.02		12.5	0.36
FrugalGPT2026.02		12.5	0.6
WTP2026.02		9.4	0.31
CARROT2026.02		9.4	0.32