Loading the SOTA2 catalog…
Inference API
OpenAI-compatible endpoint for hosted open models including GPT-OSS 120B, GPT-OSS 20B, Gemma 4 31B, GLM 5.2, and DeepSeek-OCR 2.
What is Inference API?
OpenAI-compatible endpoint for hosted open models including GPT-OSS 120B, GPT-OSS 20B, Gemma 4 31B, GLM 5.2, and DeepSeek-OCR 2. Supports streaming, tool calls, vision input, and JSON mode with no additional cost.
Product typeModel Hosting & Inference
PricingPer million tokens; GPT-OSS 120B $0.15 in / $0.60 out; GPT-OSS 20B $0.05 / $0.20; GLM 5.2 $1.82 / $5.72; DeepSeek-OCR 2 $0.039. No minimum spend; streaming included; batch at 50% off. · Usage Based
Deployment
APIAvailable
What teams use Inference API for
Production GPU inference
OpenAI-compatible LLM serving
GPU compute rental
Self-hosted GitHub Actions runners with GPU access
Integrations and access
Platforms, integrations, and language support vary by plan and region. Confirm final requirements with the vendor.
Platforms
IntegrationsAPI and webhooks
Languages
Support
What reviewers say
Community reviewsReviews are owned and editable by their authors.
Sign in to reviewLoading community reviews…
Enterprise readiness
Compliance claims are normalized from current vendor documentation and independently reviewed by SOTA2.
SOC 2 Type II
SOC 2
PCI DSS
TLS 1.3 encryption in transit
Encrypted volumes at rest
VM-level isolation with separate guest kernel
GPU passthrough via VFIO with IOMMU-enforced memory isolation
Complete GPU reset between workloads
WireGuard VPN tunnels for node-to-control-plane communication
Egress filtering
DDoS protection at edge proxy layer
HSTS enforcement
Zero-access architecture (providers cannot access workloads)
No data persistence on provider nodes by default
Secure wipe of workload data on termination
Role-based access control (Owner, Admin, Member)
Scoped and rotatable API keys
One-time use provisioning tokens with hashed storage
Audit logging of authentication and authorization events
Network segmentation and firewalls
Intrusion detection and monitoring
Regular penetration testing
Incident response procedures
Certificate pinning for control plane communications
Data retention:
Benchmarks and comparisons
Independent benchmarksStructured task results are being verified.
Side-by-side comparisonsComparison workspaces will be available in a later release.
