Guides

The problems every local-LLM user eventually hits — explained once, properly, instead of re-derived from a forum thread each time. For step-by-step "how do I run this specific model" instructions, see the Models hub instead.

Why your local LLM is suddenly 10× slower
VRAM spill, explained

No crash, no error — just a sudden slowdown. What VRAM spill actually is, why it's silent, and how to stop it.

llama.cpp flags that actually matter
-ngl, --n-cpu-moe, KV cache quant

llama.cpp has well over a hundred flags. Here are the handful that separate barely-working from genuinely fast.

MoE expert offloading
Run 100B+ models on a 24 GB card

How a 120B-parameter model runs on hardware that can't hold 120B parameters — the mechanics, explained.

llama.cpp forks worth using in 2026
And why stock isn't always enough

Why community forks exist, which ones are worth knowing, and how to run one without compiling anything yourself.

Automate a task with Routines
Daily digests, nightly test runs, on a schedule

Step-by-step: schedule a chat or Code task to run on its own, unattended, on your own machine.

TurboLLM on Kaggle
Two free T4s, no hardware required

Kaggle gives every free account a 30 GB dual-GPU box. Run the full TurboLLM UI on it from a one-click notebook.

Looking for a specific model or GPU?

These guides cover the concepts. For step-by-step setup, see the Models hub (pick a model) or What can I run? (pick your hardware).