Dedicated model deploymentsBest forDeploying almost any model from the Hugging Face Hub to a dedicated endpoint, or calling popular models through Inference Providers, which routes to partner hosts under one API.
Trade-offDedicated endpoints bill per hour while running; Inference Providers only covers models the partner hosts serve, at their prices.
Used by 77 makers' products for this
Your code on GPUsBest forRunning your own Python code — inference, batch jobs, sandboxes — on GPUs defined in code, scaling to zero between calls.
Trade-offCold starts on large models, and your code is shaped around Modal's decorators.
Used by 60 makers' products for this
Dedicated model deploymentsSelf-hostable
Best forDeploying a specific model as a production endpoint with autoscaling and monitoring.
Trade-offBuilt for production workloads; more setup than calling a shared serverless API.
Used by 23 makers' products for this
Your code on GPUsBest forRenting GPU machines by the hour or running serverless GPU workers, with control over the hardware.
Trade-offMore hands-on setup and operations than a managed platform.
Used by 19 makers' products for this
Serverless model APIBest forCalling many popular open models through one OpenAI-compatible API, with fine-tuning on the same platform.
Trade-offYou're limited to the models they host unless you pay for dedicated capacity.
Used by 12 makers' products for this
Serverless model APIIn Lovable
Best forLow-latency serving of open models, including your own fine-tuned versions.
Trade-offHosted only; dedicated deployments are needed for steady high volume.
Used by 5 makers' products for this
Open-source serving engineOpen source
Best forServing open-weight models on your own or rented GPUs behind an OpenAI-compatible API, with high throughput for many concurrent requests.
Trade-offYou own the GPUs, scaling, upgrades and on-call; tuning memory and batching settings takes real effort.
No maker product tracked for this yet
Serverless model APIBest forFast open models for coding agents (Kimi K3, GLM-5.3, Qwen, MiniMax, DeepSeek) plus its own Fast Apply, WarpGrep and Compact models, behind one OpenAI-compatible API.
Trade-offA small set of models chosen for agents; it started as a code-edit model company and has since repositioned as an inference provider.
Used by 1 maker's product for this
Serverless model APIFrom Pay per token
Best forA wide per-token catalog of open models for text, image, audio and video, with agent sandboxes and GPU instances in the same account.
Trade-offHosted only; sandboxes and GPU instances bill for time, and the catalog is whatever Novita chooses to host.
Used by 1 maker's product for this
Serverless model APIBest forVery fast open-model inference on SambaNova's own chips through the SambaCloud API.
Trade-offHosted only on its own hardware, so check the open model you need is in its catalog; it also sells on-prem racks to data centers.
No maker product tracked for this yet
From Pay per token
Best forVery fast inference on a small set of open-weight models, on Cerebras's wafer-scale chips, through an OpenAI-compatible API.
Trade-offOnly a handful of models, and reserved capacity is by contract.
No maker product tracked for this yet
Serverless model APIFree tierFrom Pay per token
Best forVery fast inference for popular open models on Groq's LPU hardware, with a rate-limited free tier.
Trade-offLimited to the models Groq hosts, and the free tier is rate-limited.
No maker product tracked for this yet
From Pay per token
Best forHundreds of open models — chat, embeddings, speech, image and video — through one OpenAI-compatible API, plus dedicated GPUs for your own models.
Trade-offHosted only; dedicated GPUs bill per GPU-hour while they run.
No maker product tracked for this yet
Serverless model APIFrom Pay per token
Best forOpen-weight models through an OpenAI-compatible per-token API (Token Factory), with dedicated endpoints, batch inference and fine-tuning on the same account.
Trade-offA card is required at sign-up and the trial is $1 of credit; you only get the models Nebius hosts.
No maker product tracked for this yet
Your code on GPUsFrom Pay per GPU-hour or per token
Best forRenting H100, H200 or B200 GPUs by the hour with no commitment, plus a small per-token API for open text models.
Trade-offThe per-token API covers only a short list of text models and needs a $5 deposit; you run everything on the GPUs yourself.
No maker product tracked for this yet
Your code on GPUsFrom Per-second GPU billing
Best forThe cheapest GPU hours, from a marketplace of hosts with per-second billing and cheaper interruptible instances.
Trade-offMachines vary by host and prices move with demand; interruptible instances can be stopped, so plan for restarts.
No maker product tracked for this yet
Your code on GPUsFrom Per GPU-hour or per token
Best forLarge NVIDIA GPU clusters for training and serving, with per-token serverless inference for open models through CoreWeave Forge.
Trade-offBuilt for large teams — the biggest systems go through sales, and it is more than a small product needs.
No maker product tracked for this yet
Your code on GPUsFrom Pay per instance-hour
Best forRunning Ray jobs — batch inference, distributed training, data processing and Ray Serve endpoints — on managed clusters or in your own cloud.
Trade-offYou have to adopt Ray; billed per instance-hour in Anyscale Credits rather than per token.
No maker product tracked for this yet
Dedicated model deploymentsBest forTrying open models on NVIDIA's hosted endpoints for free, then running the same model as a NIM container on your own GPUs.
Trade-offFree access covers development and testing only; production needs an NVIDIA AI Enterprise license or a partner's endpoint.
No maker product tracked for this yet