Xinference
Library for serving language, speech recognition, and multimodal models via a unified, production-ready inference API.
What it does
Library for serving language, speech recognition, and multimodal models via a unified, production-ready inference API.
- deploy and serve language models
- deploy and serve speech recognition models
- deploy and serve multimodal models
- Category
- Model hosting and inference
- Users
- researchers, developers, data scientists
- Public API
- Available
- Deployment
- Self-hosted, On-premises
Not yet disclosed: platforms, languages and support channels.
Pricing
Pricing isn't published
Xorbits Inference doesn't list prices publicly. Ask them for a quote.
Security and compliance
No security details published yet
Xorbits Inference hasn't published certifications or security practices for Xinference that we could find. Ask their team for audit reports.
Reviews
No reviews yet
Reviews come from people who use Xinference at work. Share how your team uses it to help other buyers decide.
Alternatives
Deploys AI models as callable endpoints on serverless GPUs.
Inference
by Beam
Deploy high-performance inference endpoints for serving custom models on GPU or CPU.
Red Hat AI Inference
by Red Hat
Optimize model performance with an integrated stack for fast, consistent, and cost-effective inference at scale.
Model Serving
by INTELLITHING
Solution for serving models via production-grade APIs with access management and monitoring; listed as a core platform capability.
Cumulus — Production-Grade Inference Platform
by Cumulus Labs
Unified inference platform with eight subsystems: Gateway, Router, Cache, Observability, Evaluation, Fine-tune, Custom Hosting, and the Ion inference engine.
Dedicated Model Inference
by Together AI
Deploy models on dedicated infrastructure.
Is this your product?
Claim it to keep details accurate and submit evidence for the next ranking review.
Claim Xinference