Vending-Bench 2
Benchmark where AI models manage a simulated vending machine business for a full year, navigating adversarial suppliers, negotiations, and customer complaints.
Where it ranks
Current edition · updated Oct 20, 2026What it does
Benchmark where AI models manage a simulated vending machine business for a full year, navigating adversarial suppliers, negotiations, and customer complaints.
- AI model evaluation
- Real-world AI safety benchmarking
- Autonomous organization research
- Category
- AI evaluation and observability
- Users
- AI research labs, AI safety researchers
- Public API
- Not offered
Not yet disclosed: deployment options, platforms, languages and support channels.
Pricing
Pricing isn't published
Andon Labs Inc. doesn't list prices publicly. Ask them for a quote.
Security and compliance
As reported by Andon Labs Inc.. Ask for audit reports before you buy.
- Technical and organizational measures for data protection (access, alteration, disclosure, destruction)
Reviews
No reviews yet
Reviews come from people who use Vending-Bench 2 at work. Share how your team uses it to help other buyers decide.
Alternatives
See the full rankingSimulation testing and evals platform for voice and chat AI agents.
#1 in Evaluate AI systems
A cloud-based business application that captures sessions from MCP servers, Claude Connectors, and ChatGPT Apps via SDKs for TypeScript, Python, and Go.
#2 in Evaluate AI systems
Superagent Red Teaming
by Superagent
Automated adversarial testing service that deploys specialized attack agents against production AI systems to surface vulnerabilities.
#3 in Evaluate AI systems
Benchmarks
by Olam Labs
Public benchmarks ranking AI models by Elo and scoring them on behavioral dimensions including bluffing, lying, negotiation, and consistency over long games.
#4 in Evaluate AI systems
AI Red Teaming
by DeepKeep
Adaptive evaluation and robustness tests.
#5 in Evaluate AI systems
Is this your product?
Claim it to keep details accurate and submit evidence for the next ranking review.
Claim Vending-Bench 2