Loading the SOTA2 catalog…
Batch Inference API
Run large offline batch inference jobs at half the per-token rate, with results delivered within 24 hours.
What is Batch Inference API?
Run large offline batch inference jobs at half the per-token rate, with results delivered within 24 hours.
Product typeModel Hosting & Inference
Pricing50% off per-token rates; results within 24 hours. · Usage Based
Deployment
APIAvailable
What teams use Batch Inference API for
Production GPU inference
OpenAI-compatible LLM serving
GPU compute rental
Self-hosted GitHub Actions runners with GPU access
Integrations and access
Platforms, integrations, and language support vary by plan and region. Confirm final requirements with the vendor.
Platforms
IntegrationsAPI and webhooks
Languages
Support
What reviewers say
Community reviewsReviews are owned and editable by their authors.
Sign in to reviewLoading community reviews…
Enterprise readiness
Compliance claims are normalized from current vendor documentation and independently reviewed by SOTA2.
SOC 2 Type II
SOC 2
PCI DSS
TLS 1.3 encryption in transit
Encrypted volumes at rest
VM-level isolation with separate guest kernel
GPU passthrough via VFIO with IOMMU-enforced memory isolation
Complete GPU reset between workloads
WireGuard VPN tunnels for node-to-control-plane communication
Egress filtering
DDoS protection at edge proxy layer
HSTS enforcement
Zero-access architecture (providers cannot access workloads)
No data persistence on provider nodes by default
Secure wipe of workload data on termination
Role-based access control (Owner, Admin, Member)
Scoped and rotatable API keys
One-time use provisioning tokens with hashed storage
Audit logging of authentication and authorization events
Network segmentation and firewalls
Intrusion detection and monitoring
Regular penetration testing
Incident response procedures
Certificate pinning for control plane communications
Data retention:
Benchmarks and comparisons
Independent benchmarksStructured task results are being verified.
Side-by-side comparisonsComparison workspaces will be available in a later release.
