Why SOTA2
Choose AI for the work you need done.
SOTA2 ranks AI products by the task you need to complete, in the industry you work in.
More AI solutions. A harder choice.
As more AI solutions come to market, CFOs, COOs, and senior executives face more options. For nontechnical buyers, it is hard to tell which product can actually do the work their business needs.
Technical benchmarks are hard to understand.
Research leaderboards use specialist terms and metrics such as HumanEval’s Pass@1. A nontechnical CFO, COO, or senior executive may struggle to understand those scores, let alone use them to choose a product.
Example from SOTA2 ResearchCode Generation on HumanEval (test)Metric: Pass@1“Which AI is best for my task?”
Buyers have a specific job to complete: draft documents, answer phone calls, or book appointments. They want to see which AI products rank highest for that job, in terms they can understand.
We’re building AI product leaderboards by task and industry.
We classify AI products by the tasks they perform and the industries they serve. Each task and industry pair gets its own comparison.
Draft documents.
In healthcare.
A healthcare buyer starts with products mapped to this task in their industry.
| Task / Industry | Healthcare | Finance | Manufacturing |
|---|---|---|---|
| Book appointments | |||
| Answer phone calls | |||
| Draft documents | Your shortlist | ||
| Monitor compliance |