Updated

MLflow

Open-source platform for the ML and GenAI lifecycle — experiment tracking, a model registry, and for LLM apps OpenTelemetry-based tracing, evaluation with LLM judges and prompt versioning.

19 open-source projects declare MLflow in their code; no maker's live product we track uses it yet.

Open sourceSelf-hostableFree tier

Profile checked

Works with AI agents:llms.txt
Ask your AI about this, with this page as the source:ChatGPT ↗Claude ↗Perplexity ↗

How makers use MLflow

What MLflow is used for

LLM Observability & Evals · Open-source platform →Tracing, evaluating and versioning prompts for LLM apps in the same open-source platform many teams already use for ML experiments.Trade-off: Grew out of classic ML tooling, so the UI and concepts are broader than an LLM-only tool; you run the tracking server yourself unless you use a managed version.
Datadog50Langfuse35Helicone13LangSmith11Braintrust6MLflow0Makers' products on each, for LLM observability & evals

MLflow vs the alternatives makers chose

OptionMakers' productsFree forAt 10,000 usersOpen source
Datadog50 43%——No
Langfuse35 30%~5,000 users$29/mo · CoreYesCompare →
Helicone13 11%~1,000 users$116/mo · ProYes
LangSmith11 9%~520 users$475/mo · DeveloperNoCompare →
Braintrust6 5%——No
Weights & Biases3 3%——No
MLflow0 0%Any size—Yes

For LLM observability & evals: how many of the 117 makers' products we know the LLM observability & evals of chose each option, and what each costs at 10,000 users.

Costs are the cheapest plan that fits, from each vendor's pricing page, at the usage our stack planner assumes for a product with that many users. Free for: the users its cheapest plan a business can use stays free for.

When to use MLflow, and when not

Something else fits better if

  • You want tracing, prompts and evals in one tool you can self-host for free: Langfuse.
  • You already use OpenTelemetry or want vendor-neutral instrumentation: Arize Phoenix.
  • You want request logs and costs today by changing one base URL: Helicone.
  • Your app is built on LangChain or LangGraph: LangSmith.
  • Your main question is whether a prompt or model change made outputs better or worse: Braintrust.
From each decision's guide, written from what makers' products chose and why.

How MLflow itself is built

19 tools, from its own code, website and Product Hunt page.

Reliability and open issues

The most wanted open issue on GitHub has 36 👍.

Most wanted on GitHub

Open on 2026-10-04 in mlflow/mlflow, with activity in the last year — issues and feature requests by 👍.

Who uses it

No maker's live product on record yet, and 19 open-source projects that declare it in their code.

We haven't found a maker's live product that uses MLflow yet — only the open-source projects below, which declare it in their code.

Dify
DifyPlatform for building LLM apps, agents and RAG workflows in a visual editor, hosted as D…LLM Observability & EvalsIn its code · source ↗

Open source: a project that declares MLflow as a dependency in its public code — verifiable, but not necessarily a live product.

Alternatives to MLflow

All alternatives by situation →

Questions makers ask about MLflow

What are the alternatives to MLflow?

For LLM observability & evals, the other options makers' products we track chose most are Datadog (50), Langfuse (35), Helicone (13), LangSmith (11), Braintrust (6), Weights & Biases (3). Open source or self-hostable among them: Langfuse, Helicone, Weights & Biases. Each alternative, with the situation it fits, is on the MLflow alternatives page.

Is MLflow free?

Yes — it is free, open-source software.

Is MLflow open source or self-hostable?

Open source, and you can self-host it. source ↗

Can AI coding agents work with MLflow?

It serves an llms.txt docs index.

Who uses MLflow?

No maker's live product we track yet; 19 open-source projects declare it in their code. source ↗