Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

VitaBench dataset and benchmarks · SOTA2 Research

Research Datasets

VitaBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Interactive Tool-Use Agent Performance

VitaBench

65Delivery Score

44

Agentic Oversight

VitaBench

82.13Detection Accuracy

42

Multi-tool calling

VitaBench held-out (test)

63.1Success Rate

28

Multi-turn tool-use interaction

VitaBench

59Delivery Score

20

Agent Performance

VitaBench OTA

9.75Avg@4

10

Agent Performance

VitaBench In-Store

32.25Avg@4

10

Agent Performance

VitaBench Delivery

29Avg@4

10

VitaBench

55.3Overall Score

8

VitaBench Delivery

30.74Avg@2

8

VitaBench In-store

34.62Avg@2

8

Popular tasks

Agent Performance Agentic Task Tool Use Agentic Oversight Interactive Tool-Use Agent Performance

Follow for updates

Join SOTA2 Contact