Use Zed with TurboLLM
Zed is a fast editor with a built-in AI assistant that speaks to OpenAI-compatible providers. TurboLLM is one of them — point Zed's assistant at your local endpoint and its AI runs entirely on your own GPU, with nothing leaving the machine.
What you need
Two things, both from a running TurboLLM instance:
- The OpenAI-compatible base URL:
http://localhost:6996/v1 - A model — load one from your library so the assistant has something to talk to.
An API key is optional. You only need one if you've turned on Require API key in TurboLLM. If that's on, create a key under Developer → API Keys and use it in Zed; if it's off, any non-empty value works.
Point Zed at TurboLLM
-
Start TurboLLM and load a model
Make sure the daemon is running on
http://localhost:6996with a model loaded. -
Add an OpenAI-compatible provider in Zed
In Zed's assistant / agent settings, add an OpenAI-compatible provider pointed at
http://localhost:6996/v1. If Zed asks for an API key, paste the one from Developer → API Keys (or any non-empty value when Require API key is off). -
Select your model
Choose the model you loaded (for example,
local). The assistant will now route its requests to TurboLLM instead of a cloud provider.
Zed's assistant settings UI and the exact field names change across versions, so we keep
this high-level on purpose. For the current config path — where to add an
OpenAI-compatible provider and what each field is called — see
Zed's own documentation.
The values you plug in stay the same: base URL http://localhost:6996/v1, an
API key only if Require API key is on, and your loaded model.
Recommended models
Coding assistants lean on tool-calling and long context. See the TurboLLM model catalog for good local picks by GPU size, then load one before pointing Zed at it.