Loading the SOTA2 catalog…
AI Services
End-to-end managed evaluation and training data collection for AI, including RLHF, safety/red-teaming, evaluator specification, and alignment feedback with dedicated QA.
What is AI Services?
End-to-end managed evaluation and training data collection for AI, including RLHF, safety/red-teaming, evaluator specification, and alignment feedback with dedicated QA.
Product typeTraining Data & Labeling
Pricing · Enterprise Custom
Deployment
APINot available
What teams use AI Services for
AI training and evaluation with human feedback
Academic and commercial research data collection
Paid online studies for participants
Integrations and access
Platforms, integrations, and language support vary by plan and region. Confirm final requirements with the vendor.
Platforms
IntegrationsAPI and webhooks
Languages
Support
What reviewers say
Community reviewsReviews are owned and editable by their authors.
Sign in to reviewLoading community reviews…
Enterprise readiness
Compliance claims are normalized from current vendor documentation and independently reviewed by SOTA2.
ISO/IEC 27001
SOC 2 Type I
Cyber Essentials
Encryption across all platforms (described as gold standard)
Network-level firewalls
Real-time automated monitoring for code vulnerabilities
Least-privilege access model
Multi-factor authentication enforced across all critical systems (VPN, developer applications, cloud infrastructure)
Production access granted on a just-in-time basis
Access authorizations reviewed at least annually; critical systems reviewed quarterly
Generic and group logins prohibited
Removable storage devices disabled where possible
Clean-desk policy
Centrally asset-managed hardware
Annual penetration testing by accredited external third parties
Vulnerability remediation under SLA with retesting
24/7 incident response via on-call rota with automated and manual triggers
Open-source vulnerability scanning with routine remediation
ISMS with 25 governance and policy documents
Annual disaster recovery testing
High availability and redundancy built into all applications
Observability stack with granular real-time monitoring and alerting
Regular data protection and security training for employees and contractors
Data retention:
Benchmarks and comparisons
Independent benchmarksStructured task results are being verified.
Side-by-side comparisonsComparison workspaces will be available in a later release.
