List your company

LangSmith Evaluation

AI evaluation and observability · by LangChain

Iteratively improve agent quality with evals; test and calibrate LLM-as-judge, code-based, or multi-turn evaluators on real production traces and compare results side-by-side.

Visit website

What it does

Iteratively improve agent quality with evals; test and calibrate LLM-as-judge, code-based, or multi-turn evaluators on real production traces and compare results side-by-side.

  • Build AI agents
  • Test AI agents
  • Deploy AI agents
  • Observe AI agents
  • Evaluate AI agents
Category
AI evaluation and observability
Users
Solo developers, Teams building and deploying agents, Enterprises with advanced hosting and security needs, VC-backed startups
Public API
Not offered

Not yet disclosed: deployment options, platforms, languages and support channels.

Pricing

  • Free plan$0

Prices as published by LangChain, checked Oct 2026.

Security and compliance

As reported by LangChain. Ask for audit reports before you buy.

  • SOC 2 Type IICompliant
  • ISO/IEC 27001Compliant
  • HIPAACompliant
  • Encryption at transit
  • Encryption at rest
  • Penetration testing performed at least annually

Reviews

No reviews yet

Reviews come from people who use LangSmith Evaluation at work. Share how your team uses it to help other buyers decide.

Write a review

Alternatives

  • Tokenshire

    by Olam Labs

    Simulated town of AI agents running autonomously for long horizons, socializing and managing government, economy, and resources under constraints.

  • LLM Leaderboard

    by LLM Stats

    Independent rankings of 300+ AI models by the composite LLM Stats Score, aggregating GPQA Diamond, SWE-Bench Verified, coding-arena performance, live output throughput, and per-...

  • ML evaluation

    by Openlayer

    Evaluate ML models with 100+ customizable tests, version comparisons, and automated CI/CD validation.

  • Ecom Bench

    by Vibrant Labs

    A benchmark analyzing verifiable shopping tasks on the live web, comparing DOM- and CUA-based methods.

  • The Context Company

    Monitor and improve AI agents in production.

  • Openlayer

    One unified platform for best-in-class AI development, testing, deployment, and governance.

Is this your product?

Claim it to keep details accurate and submit evidence for the next ranking review.

Claim LangSmith Evaluation