Llama 3.1 8B Instruct
The default local workhorse: fast, permissive license, great 8B quality — fits in 8 GB of VRAM at Q4.
Filter open-weight models by type, parameter size and license — and see how much VRAM each one needs.
4 of 4 models, sorted by rating
The default local workhorse: fast, permissive license, great 8B quality — fits in 8 GB of VRAM at Q4.
The reference open image model for local generation: 12 GB VRAM recommended, huge ecosystem of LoRAs and workflows.
Google’s mid-size open model: strong multilinguality and multimodality in a package that fits a 16 GB GPU.
Apache-licensed, 128k context, excellent multilingual quality — a strong open alternative to Llama 8B.