Term
Text-Generation-WebUI
Text-Generation-WebUI (oobabooga) is an open-source web interface for running LLMs locally. It bundles several inference backends, chat and completion modes and an OpenAI-compatible API under one common UI.
Text-Generation-WebUI — explained in detail
Text-Generation-WebUI, often simply called oobabooga after its developer, is one of the oldest and most versatile web interfaces for running language models locally. The core idea: a single Gradio-based UI that fronts several interchangeable inference backends — including llama.cpp, Transformers, ExLlamaV3 and TensorRT-LLM. Models and backends can be switched without a restart, which makes the software popular for experimenting with different quantizations and engines.
In terms of features it offers chat, instruct and notebook/completion modes, an OpenAI- and Anthropic-compatible API (Chat, Completions and Messages endpoints including tool calling), multimodal inputs (images, PDF/DOCX attachments) and LoRA training. Portable builds allow a zero-setup start for GGUF models: download, unzip, run — without installing dependencies.
Example / Practical use
A typical user loads a quantized GGUF model, launches the portable build on Windows and chats locally right away — no cloud, fully offline. To test a different engine, they switch from llama.cpp to ExLlamaV3 in the model tab to check GPU-specific speed gains. Via the OpenAI-compatible API the running instance can also serve as a drop-in backend for existing tools that otherwise call the OpenAI API.
Distinction from related terms
LM Studio pursues a similar goal but is a closed-source desktop app with a polished GUI, whereas Text-Generation-WebUI is open source and more focused on backend flexibility. Open WebUI is primarily a chat frontend layer that does no inference itself but connects to backends like Ollama. llama.cpp is one of the inference engines that Text-Generation-WebUI uses under the hood — not a competing frontend.
Entdecke mehr
Saving Tokens with Claude: 6 Principles That Make Experts Twice as Fast
How I turned my CLAUDE.md from a style guide into a token budget — 6 principles for lower cost, less waiting, and more honest reporting.
GlossarGPT4All
GPT4All is an open-source desktop application by Nomic AI for running large language models locally and offline on your own computer. It works without a GPU and without a cloud connection, so data never leaves the device.
LexikonRunning LLMs locally — hardware, tools, models
How to run language models on your own hardware — VRAM requirements, tooling (Ollama, LM Studio, llama.cpp, vLLM) and which models fit which GPU.