Updated

Helicone alternatives

For LLM observability & evals, the alternatives to Helicone that makers' products we track chose most are Datadog (50), Langfuse (35) and LangSmith (11), against 13 for Helicone itself. 15 of the 25 are open source or self-hostable (Langfuse, Arize Phoenix, Weights & Biases and 12 more) and 17 have a free tier. At 10,000 users, the cheapest is Langfuse at $29 a month on Core, against $116 for Helicone on Pro. Helicone also answers LLM gateway & routing: those alternatives are below too.

15 open source or self-hostable17 with a free tier9 ready for AI agents

Not a ranking: each option is described by the situation it fits, with its trade-off.

Helicone alternatives compared for LLM observability & evals

How many makers' products we track use each for LLM observability & evals, and what each costs at 10,000 users.

OptionKindMakers' productsAt 10,000 usersFree tierOpen source
HeliconeProxy logging13$116/mo · ProYesYes
LangfuseOpen-source platform35$29/mo · CoreYesYesCompare →
LangSmithHosted eval platform11$475/mo · DeveloperYesNoCompare →
BraintrustHosted eval platform6—YesNoCompare →
Arize PhoenixOpen-source platform0—YesSelf-hostable
DatadogHosted eval platform50——No
Weights & BiasesHosted eval platform3—YesSelf-hostable
RespanHosted eval platform2—YesNo
OpikOpen-source platform0—YesYes
PromptfooEval and test CLI0—YesYes
DeepEvalEval and test CLI0—YesYes
RagasEval and test CLI0—YesYes
MLflowOpen-source platform0—YesYes
LaminarOpen-source platform0——Yes
AgentOpsHosted eval platform0—YesYes
OpenLLMetryOpen-source platform0—YesYes
HoneyHiveHosted eval platform0—YesSelf-hostable
GalileoHosted eval platform0—YesSelf-hostable
PromptLayerHosted eval platform0—YesNo
LunaryHosted eval platform0—NoSelf-hostable
Confident AIHosted eval platform0—YesNo
HumanloopHosted eval platform0——No
Patronus AIHosted eval platform0——No
AgentaOpen-source platform0——Yes
Parea AIHosted eval platform0——No
Athina AIHosted eval platform0——No

Helicone alternatives compared for LLM gateway & routing

How many makers' products we track use each for LLM gateway & routing.

OptionKindMakers' productsFree tierOpen source
HeliconeManaged gateway + controls1YesYes
OpenRouterHosted model marketplace0YesNoCompare →
LiteLLMSelf-hosted proxy0YesYesCompare →
PortkeyManaged gateway + controls0YesYes
Vercel AI GatewayHosted model marketplace0YesNo
Kong GatewaySelf-hosted proxy2—Yes
UnifyHosted model marketplace1—No
RespanManaged gateway + controls0YesNo
MartianHosted model marketplace0NoNo
CloudflareManaged gateway + controls0YesNo

When each fits: LLM observability & evals

The whole decision →

Open-source platform you can self-host, or a hosted eval product. Open-source tools keep traces on your own servers and cost nothing to run yourself, but you maintain them. Hosted eval platforms give you polished experiment and scoring workflows for a monthly bill, with your data in their cloud.

Helicone (Proxy logging): Getting request logs, costs and latency by changing one base URL, with no SDK instrumentation. Trade-off: Proxy logging sees individual requests well but agent steps and eval workflows less deeply; acquired by Mintlify in March 2026, so check its roadmap before building on it.

Langfuse

Open-source platform
Open sourceFree tierFrom $29/mollms.txtCLI

Best forTracing, prompt management and evals in one tool you can run on your own server for free.

Trade-offSelf-hosting means running Postgres, ClickHouse, Redis and object storage alongside it; otherwise it's a usage-based cloud plan.

Used by 35 makers' products for this · Helicone vs Langfuse →

LangSmith

Hosted eval platform
Free tierFrom $39/seat/mollms.txt

Best forApps built on LangChain or LangGraph, where tracing works with almost no setup.

Trade-offPaid per seat beyond the free tier; self-hosting is enterprise-only.

Used by 11 makers' products for this · Helicone vs LangSmith →

Braintrust

Hosted eval platform
Free tierFrom $249/mollms.txtMCPCLI

Best forEval-driven work — scoring outputs and comparing prompts and models side by side in experiments.

Trade-offClosed source, and the paid tier is priced for teams rather than hobby projects.

Used by 6 makers' products for this · Helicone vs Braintrust →

Arize Phoenix

Open-source platform
Self-hostableFree tierFrom $50/mollms.txt

Best forOpenTelemetry-based tracing and evals you can start locally in a notebook, then self-host or move to its cloud.

Trade-offSource-available under the Elastic License rather than a permissive open-source license.

No maker product tracked for this yet

Datadog

Hosted eval platform

Best forTraces, token costs, errors and quality and safety evaluations for LLM apps and agents, next to the APM and logs you already have in Datadog.

Trade-offBilled as another Datadog product on top of your plan, and only worth it if the rest of your monitoring lives there; formerly called LLM Observability.

Used by 50 makers' products for this

Weights & Biases

Hosted eval platform
Self-hostableFree tierFrom $60/mo

Best forTracing and evaluating LLM apps and agents with W&B Weave, in the same account you use for experiment tracking and a model registry when you train or fine-tune models.

Trade-offSelf-hosting needs a licensed W&B Server on Kubernetes with ClickHouse; the free plan ingests 1 GB of trace data a month; now sold as CoreWeave Forge, which names its Agent Lens product as Weave's successor for agent tracing.

Used by 3 makers' products for this

Respan

Hosted eval platform
Free tierFrom $199/mo

Best forTracing, monitoring, prompt management and LLM-judge evals for agents, with a built-in gateway that logs every call it routes.

Trade-offCloud-only below Enterprise; the free plan keeps logs 7 days, and Team starts at $199/mo billed yearly.

Used by 2 makers' products for this

Opik

Open-source platform
Open sourceFree tierFrom $19/mollms.txtMCP

Best forTracing, evaluations and prompt optimization in an Apache-licensed platform you self-host with Docker or Kubernetes, or use on Comet's cloud.

Trade-offSelf-hosting means running several services; smaller community than Langfuse.

No maker product tracked for this yet

Promptfoo

Eval and test CLI
Open sourceFree tierFrom Contact salesllms.txtCLI

Best forRunning prompts and models against test cases from the command line or CI, including red-team tests for prompt injection and data leaks.

Trade-offA testing tool rather than production tracing, so you pair it with something that logs live traffic.

No maker product tracked for this yet

DeepEval

Eval and test CLI
Open sourceFree tierFrom $200/mo (Confident AI Starter)llms.txtCLI

Best forWriting LLM evals as pytest-style tests in Python, with ready-made metrics for hallucination, faithfulness and answer relevancy.

Trade-offThe metrics use an LLM as a judge, so every run costs tokens and scores vary slightly; dashboards and history are in the paid Confident AI platform.

No maker product tracked for this yet

Ragas

Eval and test CLI
Open sourceFree tierllms.txt

Best forScoring RAG pipelines — how faithful answers are to the retrieved context and how relevant that context is — and generating test questions from your documents.

Trade-offA Python library, not a platform — no tracing of live traffic or UI, and LLM-judged metrics cost tokens per run.

No maker product tracked for this yet

MLflow

Open-source platform
Open sourceFree tierllms.txt

Best forTracing, evaluating and versioning prompts for LLM apps in the same open-source platform many teams already use for ML experiments.

Trade-offGrew out of classic ML tooling, so the UI and concepts are broader than an LLM-only tool; you run the tracking server yourself unless you use a managed version.

No maker product tracked for this yet

Laminar

Open-source platform
Open source

Best forTracing, evals and debugging built for multi-step agents, self-hosted or hosted.

Trade-offSelf-hosting means running its services yourself; the hosted version saves that work.

No maker product tracked for this yet

AgentOps

Hosted eval platform
Open sourceFree tierFrom $40/mo

Best forTracing, replaying and costing multi-agent runs from a Python SDK that hooks into CrewAI, AutoGen, OpenAI and other frameworks.

Trade-offThe Python SDK hasn't had a PyPI release since August 2025, so check that it supports your framework versions.

No maker product tracked for this yet

OpenLLMetry

Open-source platform
Open sourceFree tier

Best forOpen-source OpenTelemetry instrumentation that traces model, vector store and framework calls and sends them to any OpenTelemetry backend.

Trade-offInstrumentation only — you still need a backend to store and view traces; Traceloop, its maker, is joining ServiceNow.

No maker product tracked for this yet

HoneyHive

Hosted eval platform
Self-hostableFree tierFrom Custom (Enterprise)

Best forTracing, online evaluation of live traffic, offline experiments on datasets, annotation queues and prompt versioning for agents.

Trade-offThe free plan stops at 10,000 events a month and 30 days of retention, and the only paid step is a custom-priced Enterprise plan.

No maker product tracked for this yet

Galileo

Hosted eval platform
Self-hostableFree tierFrom $100/mo (billed annually)

Best forScoring every production request with small Luna evaluator models distilled from LLM-judge metrics, then turning those evals into guardrails.

Trade-offNow owned by Cisco and priced through Splunk, billed annually; built for enterprise teams more than small ones.

No maker product tracked for this yet

PromptLayer

Hosted eval platform
Free tierFrom $49/mo

Best forA prompt registry non-engineers can edit and deploy without a redeploy, with request logs, traces and dataset evals tied to prompt versions.

Trade-offHosted only below Enterprise; the free plan logs 2,500 requests a month, and usage past plan limits is billed per request.

No maker product tracked for this yet

Lunary

Hosted eval platform
Self-hostableFrom $20/user/mo

Best forLogging LLM calls with user and conversation analytics, prompt templates and human review.

Trade-offNo free workspace for new sign-ups ($20 per user a month), and self-hosting is now an Enterprise feature.

No maker product tracked for this yet

Confident AI

Hosted eval platform
Free tierFrom $200/mo

Best forDashboards, history and regression tracking for DeepEval test runs, plus tracing, online evals and red-teaming in one hosted platform.

Trade-offThe free plan allows 5 test runs a week and one project; the next step is $200 a month.

No maker product tracked for this yet

Humanloop

Hosted eval platform

Best forTeams managing prompts, running evaluations and watching LLM apps in production.

Trade-offShut down on 2025-09-08 after the team joined Anthropic; all data was deleted, and Humanloop pointed users to Langfuse or Braintrust.

No maker product tracked for this yet

Patronus AI

Hosted eval platform

Best forEvaluating and optimizing LLM apps and agents with research-based evaluators.

Trade-offPivoted to a research lab; there is no self-serve evaluation product on its site.

No maker product tracked for this yet

Agenta

Open-source platform
Open source

Best forAn open-source, self-hostable place to manage prompts, run evaluations and trace LLM apps.

Trade-offPivoted on 2026-07-21 to a workspace for building agents; no longer an observability product.

No maker product tracked for this yet

Parea AI

Hosted eval platform

Best forExperiment tracking, evaluations and human annotation of LLM app logs.

Trade-offThe site returns HTTP 402 and the SDK stopped in February 2025; apparently shut down without notice.

No maker product tracked for this yet

Athina AI

Hosted eval platform

Best forMonitoring LLM apps in production with automatic hallucination detection and evals.

Trade-offThe site and app are down and the SDK stopped in May 2025; apparently shut down without notice.

No maker product tracked for this yet

When each fits: LLM gateway & routing

The whole decision →

Hosted gateway or self-hosted proxy. A hosted gateway gives you one key and one bill in minutes, but every request passes through someone else's service. A self-hosted proxy keeps your provider keys and traffic on your own servers, and you run and update it.

Helicone (Managed gateway + controls): Adding a gateway when your main goal is logging and debugging every request, with caching and rate limits on the side. Trade-off: Its focus is observability; routing features are thinner than a dedicated gateway's.

OpenRouter

Hosted model marketplace
Free tierFrom Pay per token + 5.5% fee on creditsllms.txtIn Replit

Best forTrying many models from many providers with one API key and one bill, without opening an account at each.

Trade-offA fee on top of provider prices, and your traffic and data pass through a third party.

No maker product tracked for this yet · Helicone vs OpenRouter →

LiteLLM

Self-hosted proxy
Open sourceFree tierFrom Contact salesllms.txtMCP

Best forRunning your own OpenAI-compatible proxy in front of your own provider keys, with retries, routing and per-key budgets.

Trade-offYou deploy, monitor and upgrade it yourself; SSO and audit logs are in the paid enterprise tier.

No maker product tracked for this yet · Helicone vs LiteLLM →

Portkey

Managed gateway + controls
Open sourceFree tierFrom $49/mollms.txtCLI

Best forA gateway that also handles guardrails, prompt management and request logs in one dashboard.

Trade-offThe free tier caps logged requests; the full control layer is a paid hosted product.

No maker product tracked for this yet

Vercel AI Gateway

Hosted model marketplace
Free tierFrom Pay per token, no markupllms.txtMCPCLIIn v0

Best forOne key and one bill for hundreds of models at provider list prices, with fallbacks and budgets, built into the AI SDK.

Trade-offTied to a Vercel team and prepaid credits, and bringing your own provider keys needs the paid tier.

No maker product tracked for this yet

Kong Gateway

Self-hosted proxy
Open source

Best forRouting, auth, token budgets and usage analytics for LLM, MCP and agent-to-agent traffic, run as AI plugins on Kong Gateway.

Trade-offBuilt for platform teams; the quickstart needs a Konnect account and token, and it is a heavy setup if all you want is one key for several models.

Used by 2 makers' products for this

Unify

Hosted model marketplace

Best forOne API in front of many models that routed each prompt to the best one for quality, cost and speed.

Trade-offPivoted away from routing (now continual-learning models for agent teams); there is no gateway or pricing page.

Used by 1 maker's product for this

Respan

Managed gateway + controls
Free tierFrom $199/mo

Best forOne OpenAI-compatible endpoint to 1,000+ models with fallbacks, caching, spend limits and every request logged in the same place you run evals.

Trade-offRequests pass through its cloud; the free plan caps proxy throughput at 412 requests a minute, and the self-hostable part is only the new open-source gateway.

No maker product tracked for this yet

Martian

Hosted model marketplace
From Pay per token

Best forOne prepaid key for 200+ models behind OpenAI- and Anthropic-compatible endpoints, usable from Claude Code, Cursor and the Vercel AI SDK.

Trade-offA side offering of a research lab whose homepage no longer mentions it; no free tier, and keys fail until you buy credits.

No maker product tracked for this yet

Cloudflare

Managed gateway + controls
Free tierFrom $5/mo (Workers Paid)llms.txtMCP

Best forLogging, caching, rate limits, spend limits and fallbacks in front of OpenAI, Anthropic, Workers AI and 20+ other providers, free on any Cloudflare account.

Trade-offLogs count against Workers Logs pricing for new accounts, buying model credits through Unified Billing adds a 5% fee, and dynamic routing, guardrails and BYOK are still in beta.

No maker product tracked for this yet

Questions

What is the best alternative to Helicone?

It depends on what you need it for; we don't rank them. The one makers' products we track chose most for LLM observability & evals is Datadog (50 makers' products). You want tracing, prompts and evals in one tool you can self-host for free: Langfuse. You already use OpenTelemetry or want vendor-neutral instrumentation: Arize Phoenix. Your app is built on LangChain or LangGraph: LangSmith.

Is there a free alternative to Helicone?

Yes. For LLM observability & evals, Langfuse, LangSmith, Braintrust, Arize Phoenix, Weights & Biases, Respan and 11 more have a free tier a small product can start on.

Is there an open-source alternative to Helicone?

Yes. For LLM observability & evals: Langfuse, Arize Phoenix (self-hostable), Weights & Biases (self-hostable), Opik, Promptfoo, DeepEval and 9 more.

What is the cheapest alternative to Helicone?

At 10,000 users, the cheapest is Langfuse at $29 a month on Core, against $116 for Helicone on Pro. From each vendor's pricing page.