Open-weight modelSelf-hostable
Best forMeta's widely supported open-weight models, available in every local runtime and in many sizes.
Trade-offCustom license with use restrictions rather than an open-source license; no new Llama release since Llama 4 in April 2025, as Meta's developer platform now centres on its hosted Muse models.
Used by 21 makers' products for this
Desktop appSelf-hostable
Best forBrowsing, downloading and chatting with models in a GUI, then serving them through a local API.
Trade-offFree but not open source.
Used by 4 makers' products for this
Inference engineOpen source
Best forFull control over builds, quantization and hardware flags, or embedding inference inside your own app.
Trade-offYou compile it, convert models and pick settings yourself.
Used by 1 maker's product for this
Desktop appOpen source
Best forAn open-source desktop app for downloading and chatting with local models, with a local OpenAI-compatible server.
Trade-offFewer model-management and tuning options than LM Studio.
No maker product tracked for this yet
Inference engineOpen source
Best forRunning and fine-tuning models on Apple silicon Macs, using unified memory efficiently.
Trade-offApple silicon only, and models need MLX-format weights.
No maker product tracked for this yet
Open-weight modelOpen source
Best forA broad open-weight family — chat, coding, vision and embeddings — in many sizes, mostly under Apache 2.0.
Trade-offDeveloped by Alibaba in China, which matters to some customers' procurement rules.
No maker product tracked for this yet
Open-weight modelOpen source
Best forOpenAI's open-weight reasoning models under Apache 2.0, with the 20B version running on a well-equipped laptop.
Trade-offOnly two sizes, both text-only, and the 120B version needs a large GPU.
No maker product tracked for this yet
Open-weight modelOpen source
Best forGoogle's small and mid-size open models, built to run on laptops and phones, with Gemma 4 under Apache 2.0.
Trade-offEarlier Gemma versions carry Google's own terms of use, so check which version you ship.
No maker product tracked for this yet