AI Software
The runners and tools that make local AI usable: Ollama, LM Studio, llama.cpp, vLLM, ComfyUI and RAG frameworks — reviewed for platforms, pricing and the experience level they demand.
Ollama
The simplest way to run local LLMs: one install, one command, an OpenAI-compatible API. Our default recommendation for beginners.
ComfyUI
The node-based powerhouse for local image generation: maximum control, the fastest-moving workflow ecosystem in AI art.
LM Studio
A polished desktop app for local LLMs: GUI model search, one-click downloads, a chat UI and a local server.
llama.cpp
C/C++ inference engine for LLMs: the best performance per gigabyte of VRAM, full GGUF quantization tooling, and the backbone of Ollama and LM Studio.
vLLM
High-throughput LLM serving engine with PagedAttention and continuous batching — the standard for multi-user and API workloads, with an OpenAI-compatible server.