Evidently Open-source
Open-source AI evaluation framework to evaluate, test, and monitor LLMs, RAG applications, AI agents, and ML models in a single framework, licensed under Apache 2.0.
Where it ranks
Current edition · updated Oct 20, 2026What it does
Open-source AI evaluation framework to evaluate, test, and monitor LLMs, RAG applications, AI agents, and ML models in a single framework, licensed under Apache 2.0.
- AI evaluation and testing
- ML model monitoring
- LLM quality and safety evaluation
- Data drift detection
- Category
- AI evaluation and observability
- Users
- AI teams, ML engineers, Data scientists, AI product managers
- Public API
- Not offered
- Deployment
- Self-hosted
Not yet disclosed: platforms, languages and support channels.
Pricing
- Free plan$0
Prices as published by Evidently AI, checked Oct 2026.
Security and compliance
No security details published yet
Evidently AI hasn't published certifications or security practices for Evidently Open-source that we could find. Ask their team for audit reports.
Reviews
No reviews yet
Reviews come from people who use Evidently Open-source at work. Share how your team uses it to help other buyers decide.
Alternatives
See the full rankingArize AX
by Arize AI, Inc.
Managed AI engineering platform for improving AI agents and applications by observing real behavior, evaluating quality, and proving each change works before you ship.
#1 in Evaluate AI systems
The AI observability platform for building quality AI products.
#2 in Evaluate AI systems
End-to-end voice and chat AI testing and observability platform.
#3 in Evaluate AI systems
Web-based platform that turns production data into staging environments for AI agent testing and validation, catching failures before users do.
#4 in Evaluate AI systems
One unified platform for best-in-class AI development, testing, deployment, and governance.
#5 in Evaluate AI systems
Coval
by Coval, Inc.
Voice AI evaluation platform for testing, monitoring, and improving voice agents at scale.
#6 in Evaluate AI systems
Is this your product?
Claim it to keep details accurate and submit evidence for the next ranking review.
Claim Evidently Open-source