List your company

Dedicated Model Inference

Model hosting and inference · by Together AI

Deploy models on dedicated infrastructure.

Visit website

What it does

Deploy models on dedicated infrastructure. Purpose-built for teams who need speed, control, and the best economics in the market.

  • Inference
  • Fine-tuning
  • GPU clusters
  • Model shaping
  • Pre-training
Category
Model hosting and inference
Users
AI-native teams, Enterprise developers, Production AI workloads
Public API
Not offered

Not yet disclosed: deployment options, platforms, languages and support channels.

Pricing

  • Free plan$0
  • Usage-based$5.49/hour
    • Per hour for H100 80GB
    • Billed by the minute per ready replica
    • On-demand hardware billing or reserved capacity

Free trial on paid plans

Prices as published by Together AI, checked Oct 2026.

Security and compliance

As reported by Together AI. Ask for audit reports before you buy.

  • SOC 2 Type IICompliant
  • Zero data retention (ZDR): Together does not store inputs or outputs by default; temporary caching may be used for performance unless otherwise configured.
  • Training opt-in: Data sharing for training other models is opt-in and not enabled by default; configurable in Organization Settings under Privacy.
  • Organization-level privacy toggles: Admins can control storing prompts/responses, allowing data for training, and allowing passthrough models.
  • Passthrough model isolation: Non-passthrough models run on Together's own infrastructure with no call-out to model authors; passthrough is a separate organization-level toggle.
  • VPC-based deployments and private networking available for enterprise customers.
  • OIDC authentication supported for GPU Clusters.
  • Single sign-on (SSO) listed under Administration features.

Reviews

No reviews yet

Reviews come from people who use Dedicated Model Inference at work. Share how your team uses it to help other buyers decide.

Write a review

Alternatives

  • Ollama

    CLI, API, and desktop apps for running open models locally or via cloud, with access to faster, larger models on datacenter-grade hardware.

  • LitServe

    by Lightning AI

    AI model serving framework listed in Lightning AI documentation.

  • Deploy

    by Roboflow

    Run models on device, at the edge, in your VPC, or via API.

  • Flora Engine

    by Databiomes

    A production inference engine that delivers high-speed on-device AI inference on consumer CPUs without requiring GPUs.

  • Inference

    by mlop

    Inference product marked as Coming Soon.

  • Scale Spellbook

    by Scale AI

    Scale Model Service for inputting customer materials into a machine learning model hosted by Scale.

Is this your product?

Claim it to keep details accurate and submit evidence for the next ranking review.

Claim Dedicated Model Inference