Running LLMs locally — hardware, tools, models
How to run language models on your own hardware — VRAM requirements, tooling (Ollama, LM Studio, llama.cpp, vLLM) and which models fit which GPU.
Redaktion
Lokales LLM (Konzepte)
Konzepte rund um lokalen Modellbetrieb — Formate, Quantisierung, Hardware.