List your company

Red Hat AI Inference

Model hosting and inference · by Red Hat

Optimize model performance with an integrated stack for fast, consistent, and cost-effective inference at scale.

Visit website

What it does

Optimize model performance with an integrated stack for fast, consistent, and cost-effective inference at scale. Features vLLM runtime for maximizing inference throughput, pre-optimized model repository for rapid model serving, and LLM compressor for reducing compute costs.

  • Build, deploy, and monitor AI models and apps
  • Enterprise-wide automation
  • Application modernization
  • Linux standardization
Category
Model hosting and inference
Users
Enterprise IT, DevOps teams, Platform engineers, AI developers and 1 more
Public API
Not offered

Not yet disclosed: deployment options, platforms, languages and support channels.

Pricing

Pricing isn't published

Red Hat doesn't list prices publicly. Ask them for a quote.

Security and compliance

No security details published yet

Red Hat hasn't published certifications or security practices for Red Hat AI Inference that we could find. Ask their team for audit reports.

Reviews

No reviews yet

Reviews come from people who use Red Hat AI Inference at work. Share how your team uses it to help other buyers decide.

Write a review

Alternatives

  • Pipeshift Inference Platform

    by Pipeshift

    Managed inference clusters with optimized model runtimes and SoTA workload orchestration to scale real-time agents across clouds and regions with ultra-low latency.

  • Beta9 (Beam OSS)

    by Beam

    Open-source self-hosted Beam runtime deployable to Amazon EKS.

  • Scale Spellbook

    by Scale AI

    Scale Model Service for inputting customer materials into a machine learning model hosted by Scale.

  • AI Controller

    by Qubrid AI

    Enterprise software for on-premise GPU infrastructure management, deployment, monitoring, and knowledge base creation at any scale.

  • MetalRT

    by RunAnywhere, Inc.

    A hand-written inference engine for Apple GPUs that supports LLMs, VLMs, speech-to-speech, and embeddings.

  • Dedicated Model Inference

    by Together AI

    Deploy models on dedicated infrastructure.

Is this your product?

Claim it to keep details accurate and submit evidence for the next ranking review.

Claim Red Hat AI Inference