List your company

Serverless Inference

Model hosting and inference · by Together AI

The fastest way to run open-source models on demand.

Visit website

What it does

The fastest way to run open-source models on demand. Powered by cutting-edge inference research. No infrastructure to manage, no long-term commitments.

  • Inference
  • Fine-tuning
  • GPU clusters
  • Model shaping
  • Pre-training
Category
Model hosting and inference
Users
AI-native teams, Enterprise developers, Production AI workloads
Public API
Not offered

Not yet disclosed: deployment options, platforms, languages and support channels.

Pricing

  • Free plan$0

Free trial on paid plans

Prices as published by Together AI, checked Oct 2026.

Security and compliance

As reported by Together AI. Ask for audit reports before you buy.

  • SOC 2 Type IICompliant
  • Zero data retention (ZDR): Together does not store inputs or outputs by default; temporary caching may be used for performance unless otherwise configured.
  • Training opt-in: Data sharing for training other models is opt-in and not enabled by default; configurable in Organization Settings under Privacy.
  • Organization-level privacy toggles: Admins can control storing prompts/responses, allowing data for training, and allowing passthrough models.
  • Passthrough model isolation: Non-passthrough models run on Together's own infrastructure with no call-out to model authors; passthrough is a separate organization-level toggle.
  • VPC-based deployments and private networking available for enterprise customers.
  • OIDC authentication supported for GPU Clusters.
  • Single sign-on (SSO) listed under Administration features.

Reviews

No reviews yet

Reviews come from people who use Serverless Inference at work. Share how your team uses it to help other buyers decide.

Write a review

Alternatives

  • Ollama

    CLI, API, and desktop apps for running open models locally or via cloud, with access to faster, larger models on datacenter-grade hardware.

  • LitServe

    by Lightning AI

    AI model serving framework listed in Lightning AI documentation.

  • Deploy

    by Roboflow

    Run models on device, at the edge, in your VPC, or via API.

  • Flora Engine

    by Databiomes

    A production inference engine that delivers high-speed on-device AI inference on consumer CPUs without requiring GPUs.

  • Inference

    by mlop

    Inference product marked as Coming Soon.

  • Scale InstantML

    by Scale AI

    Scale Model Service for inputting customer materials into a machine learning model hosted by Scale.

Is this your product?

Claim it to keep details accurate and submit evidence for the next ranking review.

Claim Serverless Inference