AI Task Builder

What it does

• AI training and evaluation with human feedback
• Academic and commercial research data collection
• Paid online studies for participants

Category

Training data and labeling

Users

AI/ML developers, Academic researchers, Commercial/industry researchers, Government agencies

Public API

Not offered

Not yet disclosed: deployment options, platforms, languages and support channels.

Pricing

• Free plan$0

Prices as published by Prolific, checked Oct 2026.

Security and compliance

As reported by Prolific. Ask for audit reports before you buy.

• ISO/IEC 27001Compliant
• SOC 2 Type ICompliant
• Cyber EssentialsCompliant

• Encryption across all platforms (described as gold standard)
• Network-level firewalls
• Real-time automated monitoring for code vulnerabilities
• Least-privilege access model
• Multi-factor authentication enforced across all critical systems (VPN, developer applications, cloud infrastructure)
• Production access granted on a just-in-time basis
• Access authorizations reviewed at least annually; critical systems reviewed quarterly
• Generic and group logins prohibited
• Removable storage devices disabled where possible
• Clean-desk policy
• Centrally asset-managed hardware
• Annual penetration testing by accredited external third parties
• Vulnerability remediation under SLA with retesting
• 24/7 incident response via on-call rota with automated and manual triggers
• Open-source vulnerability scanning with routine remediation
• ISMS with 25 governance and policy documents
• Annual disaster recovery testing
• High availability and redundancy built into all applications
• Observability stack with granular real-time monitoring and alerting
• Regular data protection and security training for employees and contractors

Reviews

• 

  Custom Evals and Training Datasets

  by AfterQuery

  Tailors evaluation suites and training datasets to specific capability targets, designing every prompt, rubric, and environment from scratch.

• 

  Hub Audio Dataset

  by Hub.xyz

  Multilingual field recordings with speaker diarization, language and accent tags, and per-utterance emotion labels.

• 

  Annotate

  by Roboflow

  Label images fast with AI-assisted data annotation.

• 

  AI Training

  by Braintrust

  Human data and AI training workforce infrastructure providing RLHF specialists, data annotators, labelers, and AI model evaluation experts for enterprise AI teams.

• 

  Cortex AI Dataset Platform

  by Cortex AI

  The world's most diverse real-world, real-workplace, and industry-scale egocentric + robot dataset for embodied AI.

• 

  Centaur.ai

  by Centaur Labs

  Centaur.ai is a collective intelligence platform for data labeling and model evaluation that combines multiple independent expert and AI judgments to produce confidence-scored,...