Skip to content

Guides

Step-by-step tutorials: installing and running local LLMs, choosing hardware, building RAG pipelines and working with agents — written to be followed, not just read.

How to Run a Local LLM on Linux with Ollama

Install Ollama on Linux with one curl line, wire the systemd service, and get the GPU detected — exact "no compatible GPUs" log strings and fixes.

beginnerlocal-llm Oct 25, 2026

How to Run a Local LLM with llama.cpp

Install llama.cpp, serve a GGUF model with the unified llama CLI on port 9931, and benchmark with llama bench — exact commands and error strings.

intermediatesoftware Oct 25, 2026

How to Run a Local LLM on macOS with Ollama

Install Ollama on macOS (Sonoma+, Apple Silicon): drag Ollama.app, fix the Gatekeeper "damaged" error, pull llama3.1:8b, and check ~21 tok/s on M4.

beginnerlocal-llm Oct 25, 2026

How to Run a Local LLM Server with vLLM

Install vLLM with uv, serve any Hugging Face model with one command on port 8000, and read the exact CUDA driver errors before you hit them.

intermediatesoftware Oct 25, 2026

Best GPU for Local AI in 2026: Ranked by VRAM

Seven GPUs ranked for local AI, from a $200 P40 to a $5,000 RTX 5090. Prices as of October 2026, what each card runs, and which one to buy for your model.

beginnerhardware Oct 24, 2026

Run Llama 3.1 8B on a 16 GB GPU

Install Ollama and run Llama 3.1 8B at 35-68 tokens per second on a 16 GB GPU: VRAM math, context limits, and the exact errors to fix.

beginnerlocal-llm Oct 24, 2026

How to Estimate VRAM for Any LLM: The Math

Two formulas — weight size and KV cache — predict the VRAM any LLM needs. Worked examples for 8B models on 8 GB and 16 GB GPUs.

intermediatehardware Oct 24, 2026

How to Choose a GPU for Local AI: VRAM First

Pick the model first, then the GPU: VRAM math for 8B to 70B models, card tiers with street prices as of October 2026, and what each tier runs.

intermediatehardware Oct 10, 2026