LangSmith alternatives
Which one is right depends on why you are leaving. Langfuse if you want open source and self-hosting. Arize Phoenix or MLflow if you want it free and local. Confident AI and DeepEval if you want more metrics or red teaming. Braintrust if you want a sharper eval loop. Mirrors only if the blocker is having nowhere safe for the agent to run, not the scoring.
Last updated 2 August 2026. Every price below was checked against the vendor's own site on 2 August 2026.
The shortlist
| Tool | What it is | Cost or license | Pick it when |
|---|---|---|---|
| Langfuse | Open source observability and evals, OpenTelemetry-native, owned by ClickHouse since January 2026. | MIT (Expat) except the ee/ directories. Cloud: Hobby $0, Core $29/mo, Pro $199/mo, Enterprise $2,499/mo. | Open source or self-hosting is a requirement rather than a preference. |
| Arize Phoenix | A local-first open source tracer with evals, from the Arize team. | Free to self-host. Server and evals are Elastic License 2.0; the client and the OpenTelemetry wrapper are Apache-2.0. | You want tracing running on your own machine this afternoon, with no account. |
| Arize AX | Production observability and evaluation, with classic ML monitoring in the same platform. | Free $0 (25,000 spans a month, 15-day retention). Pro $50/mo (50,000 spans a month, 30-day retention). Enterprise custom. | One team owns both a fraud model and an agent and does not want two platforms. |
| MLflow | The open source ML lifecycle platform, with GenAI tracing and evaluation alongside the classic parts. | Apache-2.0, free to self-host. Databricks sells a managed version. | You already run MLflow and would rather not add another vendor. |
| Confident AI (DeepEval) | The broadest metric library in the category, plus DeepTeam for red teaming. | DeepEval is Apache-2.0 and runs locally. Confident AI: Free forever, Starter $200/mo per organization with unlimited seats, Team $2,000/mo. | You want metric breadth, or something shaped like a compliance artifact. |
| Braintrust | An evaluation platform: datasets, scorers, experiments, and a store built for trace queries. | Starter $0 with $10 of model credits, 1 GB then $4 per GB, 10,000 scores then $2.50 per 1,000. Pro $249/mo. | Iterating on scorers is the loop you want to be fast. |
| Mirrors | A runnable rebuild of the systems your agent calls (databases, internal APIs, tools), plus replay of recorded sessions against a prompt, tool, or model change. | Free $0/month with 60 replay-minutes, then $0.20 per replay-minute. Enterprise custom. | The agent has nowhere safe to act. Scoring is not what is blocking you. |
Prices and limits checked against each vendor's own site on 2 August 2026, and every one of those sites is linked at the foot of this page. Self-hosting is free of license cost, not free: you run and operate the stack, and that is a real line in the budget.
When to stay on LangSmith
If your agent is built on LangChain or LangGraph, the marginal cost of keeping LangSmith is close to one environment variable, and nothing in this roundup will be cheaper to keep than the thing that already works. Leaving over a feature you have not tried to configure is the most common way this goes badly.
Stay too if what you need is production monitoring at real volume, tracing in Go or Java, or SSO with SCIM and role controls. LangSmith Enterprise is the only tier here that runs self-hosted or hybrid inside your own VPC without giving up the hosted feature set, and a team that replaces it to save $39 a seat a month usually ends up rebuilding half of it.
And if you have neither observability nor a test environment today, start with observability. You cannot rebuild, replay, or score what you never recorded.
You want to self-host, or you want open source
This is the reason with the cleanest answer, and it is why most of these searches start. LangSmith will self-host, but only on Enterprise, so a small team that needs the traces to stay inside its own network has no priced path to it.
One detail worth being precise about, because it gets repeated wrongly: the Langfuse self-hosted build includes SSO and project-level role controls at no license cost, and its evals, annotation queues, and playground have not been behind a paid plan since June 2025. Self-hosting it does not get you a crippled edition.
Langfuse
Open source LLM observability, evals, and prompt management, OpenTelemetry-native, acquired by ClickHouse in January 2026.
It is the closest feature-for-feature replacement on this list, and the only one where self-hosting is the recommended path rather than a concession. Because it is OpenTelemetry-native, the instrumentation you write is not hostage to it: if you leave again, your traces still mean something.
MIT (Expat) except the ee/ directories. Cloud Hobby $0 (50,000 units a month, 2 users), Core $29/mo, Pro $199/mo, Enterprise $2,499/mo. The Teams add-on is $300/mo and adds enterprise SSO and project-level RBAC on cloud.
Arize Phoenix by Arize
A local-first open source tracer with evals, datasets, and a playground, maintained alongside the Arize AX platform.
The shortest distance between having nothing and seeing what your agent actually did. It runs on your machine with no account, and the team behind it maintains OpenInference alongside OpenTelemetry, so the instrumentation is portable.
Free to self-host, split-licensed: the server and the evals are Elastic License 2.0, the client and the OpenTelemetry wrapper are Apache-2.0. Read it as two licenses if you plan to build on it.
You want a smaller bill
Two shapes of answer. Either you self-host and pay in operator time instead of subscription, which is everything in the section above, or you move to a hosted tier that meters something cheaper. On the hosted side the cheapest credible option is Langfuse Cloud, listed above: Hobby is $0 for 50,000 units a month across 2 users, and Core is $29 a month.
Before switching on price, work out what you are actually paying for. LangSmith meters base traces in normalized LangSmith Units: 1 LSU is $1.00 and a base trace is 0.005 LSU since the July 2026 repricing, with 14 days of base retention and 400 days extended. Whether that is expensive depends entirely on your trace volume and shape, so convert last month's real usage before assuming. A migration you did not need is the most expensive item on this page.
Arize AX by Arize
Production observability and evaluation for agents, in the same platform as classic ML monitoring, drift, and embedding analysis.
The published tiers are cheap and the free one is usable: $0 for 25,000 spans a month at 15-day retention, $50 a month for 50,000 spans at 30 days. It is also the only platform in this roundup that covers classic ML models as well as agents, which matters if one team owns both.
Free $0 (25,000 spans a month, 15-day retention). Pro $50/mo (50,000 spans a month, 30-day retention). Enterprise custom and not published.
MLflow
The open source ML lifecycle platform, which now carries GenAI tracing and evaluation next to the experiment tracking and model registry it has always had.
If your organization already runs MLflow for classic ML, the cheapest observability platform is usually the one whose server is already up and whose access controls are already argued about. Fewer vendors is a real feature.
Apache-2.0 and free to self-host. Databricks sells a managed version.
You want more metrics, or you want red teaming
LangSmith's eval surface is complete rather than deep: offline and online evals, LLM-as-judge, datasets, annotation queues, and CI through pytest and Vitest. Teams that leave over evaluation are usually not missing the framework, they are missing a library of metrics they did not have to write, or they have been handed a security question they cannot answer with any of it.
There is one answer to both, and it is the same product.
Confident AI by DeepEval
The platform around DeepEval, the most-adopted open source eval framework in the category, plus DeepTeam for red teaming.
Metric breadth, and it is not close: more than 50 metrics including G-Eval and DAG, a deterministic decision-tree judge you can reason about, 11 agentic metrics, and RAG evaluation worked out properly. DeepTeam covers 40+ vulnerability types with mappings to the OWASP LLM Top 10, NIST AI RMF, and MITRE ATLAS, which is the only thing in this roundup shaped like the artifact a security review asks for. Assertions look like pytest tests, so the suite lands in CI the way your other tests already did.
DeepEval is Apache-2.0, free, and runs entirely on your own machine with no account. Confident AI: Free forever (2 seats, 1 project, 5 test runs a week), Starter $200/mo per organization with unlimited seats, Team $2,000/mo, Enterprise custom.
You want a sharper eval loop
This one is a taste judgement rather than a capability gap, and it is still a real reason to move. If the thing you do forty times a day is change a scorer and re-run, the friction of that loop is most of your working life.
The trade is what you pay for. Braintrust meters gigabytes of data processed and number of scores rather than traces or seats, which is not more expensive so much as differently shaped, and it is harder to forecast until you have run a month of your own volume through it.
Braintrust
An evaluation and observability platform built around datasets, tasks, scorers, and experiment comparison, with Brainstore underneath for trace queries.
The dataset, task, scorers, run, compare-against-last-run loop has the least ceremony of anything here, the autoevals library ships the scorers so nobody writes a judge from scratch on day one, and Loop helps write scorers, which is the step most teams actually stall on. Unlimited seats on every tier including the free one means access to results is never rationed.
Starter $0 with $10 of model credits, 1 GB included then $4 per GB, 10,000 scores then $2.50 per 1,000, 14-day retention. Pro $249/mo. Enterprise custom.
Your problem is not scoring at all
There is a version of this search that none of the six options above answers, and it is worth naming because it costs people weeks. If you replace LangSmith and the thing you still cannot do is run the agent at all, because it calls an internal API nobody will give you a test instance of, or because every test run charges a real card or deletes a real record, then you do not have a scoring problem. Every product above scores a run that already happened somewhere, and somewhere is the part you are missing.
That is the gap Mirrors fills, and it is the only reason we are on our own roundup. Most readers of this page should skip this section: if your agent mostly reads, a RAG assistant, a summarizer, a classifier, then nothing it touches needs standing in for and the problem does not exist for you.
Mirrors
A runnable rebuild of the systems your agent calls (databases, internal APIs, tools), plus replay of recorded sessions against a prompt, tool, or model change.
It reads your traces, your code, or your API docs and stands up the systems the agent calls: a running service per tool, each with a schema, fabricated seed records, and state that changes as the agent acts and resets between runs. That is what makes a refund safe to issue in a test and a session repeatable a hundred times. It scores nothing, so it replaces none of the products above, and most teams run one of them alongside it.
Free $0/month with 60 replay-minutes, then $0.20 per replay-minute. Enterprise custom.
How to test an agent that calls internal APIs with no staging environment →
What moving actually costs
The migration is mostly instrumentation and history, in that order. Langfuse, Arize, and MLflow all accept OpenTelemetry, so if your tracing already goes through OTel the code change is an endpoint and a header. If it goes through the LangSmith SDK directly, budget a day per service to swap it, and run both for a week rather than cutting over.
History is the part people forget. Traces on the old platform generally do not move, and retention windows differ (LangSmith is 14 days at base, Braintrust 14 days on Starter, Arize AX 15 days on Free), so export anything you need for a baseline before you stop paying. Prompts, datasets, and annotations are usually exportable through each platform's API and are worth taking with you.
And whatever you land on, keep the eval set. The scorers are portable in principle and the cases are the asset: they encode what your team decided "good" means, and rewriting them is what actually takes the quarter.
Check it yourself
- LangSmith pricing
- Langfuse pricing
- Arize pricing
- Arize Phoenix
- MLflow
- Confident AI pricing
- DeepEval on GitHub
- Braintrust pricing
The other roundups
- Braintrust alternatives: Five real options grouped by reason for leaving, plus the case for not switching at all.