Braintrust iconBraintrust

Evaluation-first AI observability platform used by Notion, Stripe and Vercel to trace, test and improve LLM apps and agents

$80M Series B (2026)
$800M Reported Valuation
Unlimited Users on Every Plan

Overview

Braintrust is an evaluation and observability platform for AI products. Its starting point is evals: you build datasets, write scorers (code or LLM-as-judge), and run experiments that show exactly which examples got better or worse when you change a prompt, model or agent. The same platform logs production traces, so real user interactions can be scored online and turned into new test cases. A playground lets engineers and product managers iterate on prompts side by side, and Loop, an AI agent, helps write scorers and analyze results.

Under the hood Braintrust built its own database for large, deeply nested agent traces. It raised an $80M Series B in February 2026 led by ICONIQ, with Andreessen Horowitz and Greylock, at a reported $800M valuation. Customers include Notion, Stripe, Vercel, Zapier, Replit, Ramp, Dropbox and Cloudflare.

The Verdict

Who Should Use Braintrust?

Best For

  • Product teams that ship AI features weekly and need regression tests
  • Eval-driven development with engineers and PMs together
  • Large agent traces in production
  • Teams that want hosted or on-premises deployment

Not Ideal For

  • Teams that require open-source, self-hosted tooling for free
  • Very small projects that only need basic logging
  • Budget-limited teams once usage exceeds the free tier

What's Great

  • Best-in-class experiment comparison and diffing
  • Production traces flow straight into eval datasets
  • Unlimited users on every plan, including free
  • Proven at well-known AI product companies
  • SOC 2 Type II, SSO and on-prem on Enterprise

Watch Out For

  • Pro plan jumps to $249/month
  • Free tier keeps data for only 14 days
  • Not open source
  • Eval setup takes upfront investment to pay off

Pricing

View all features & details

Key Features

  • Experiments with example-level diffs
  • Datasets and custom scorers
  • Production logging and online scoring
  • Prompt playground
  • Loop agent for scorers and analysis
  • Human review and annotation

Integrations

  • Python and TypeScript SDKs
  • OpenAI, Anthropic and other providers
  • Vercel AI SDK, LangChain, OpenAI Agents SDK
  • OpenTelemetry ingestion
  • CI integration for eval gates

How It Compares

Feature Braintrust LangSmith Langfuse Arize Phoenix
Eval-first workflow Core Yes Yes Yes
Open source No No MIT Elastic 2.0
Users on free tier Unlimited 1 seat 2 users Unlimited (self-host)
On-prem Enterprise Enterprise Free self-host Free self-host
Paid entry $249/mo $39/seat $29/mo $50/mo (AX)

Is this your tool? Add a badge