KI-Werkzeuge

Accelerate is an open-source library from Hugging Face that makes PyTorch training code run on any hardware and in distributed setups with minimal changes — including mixed precision and FSDP and DeepSpeed support.

Aider is an open-source AI pair programmer for the command line that edits code directly in the Git repository and commits every change automatically.

A safety layer in Claude Code: a small LLM evaluates every tool call that is not explicitly allowlisted, live, and blocks destructive or unauthorised actions before they execute.

AutoGen is an open-source framework from Microsoft for building multi-agent applications with LLMs. Several AI agents solve tasks together in structured conversations — for example group chats or asynchronous message passing.

Chroma (ChromaDB) is an open-source vector database for storing and searching embeddings. It is widely used in RAG systems to retrieve relevant text passages via similarity search and feed them to language models.

Claude Code is Anthropic's official AI coding tool — available as a terminal CLI, VS Code extension, JetBrains plugin and web app, with a strong focus on tool use and configurable workflows.

Continue.dev is an open-source, model-agnostic AI coding extension for VS Code and JetBrains — configured via YAML, working with commercial as well as local models.

CrewAI is an open-source framework for orchestrating multiple autonomous AI agents. It assigns agents roles, goals and tools and has them collaborate in teams ("crews") to solve complex tasks through coordinated, multi-step workflows.

Cursor is an AI-first code editor — a fork of Visual Studio Code with AI deeply wired into the editor itself.

Datasets is an open-source Python library from Hugging Face for loading, processing and sharing machine-learning datasets. It uses Apache Arrow and memory-mapping to handle even very large amounts of data efficiently.

Diffusers is an open-source Python library by Hugging Face for using and training diffusion models for image, video and audio generation. It is built on PyTorch and is structured into pipelines, models and schedulers.

DSPy is an open-source Python framework from the Stanford NLP group that lets you program LLM applications instead of hand-crafting prompts. Tasks are described through declarative signatures and modules; optimizers automatically derive effective prompts and examples.

Flowise is an open-source low-code tool for building LLM applications and AI agents visually via drag-and-drop. It is built on the LangChain ecosystem and connects models, data sources and tools as nodes.

GitHub Copilot is GitHub's AI coding assistant — an extension for common editors offering tab autocomplete, chat and multi-file edits, with GPT and Claude models selectable.

GPT4All is an open-source desktop application by Nomic AI for running large language models locally and offline on your own computer. It works without a GPU and without a cloud connection, so data never leaves the device.

Haystack is an open-source AI orchestration framework from deepset for building production-ready LLM applications. Modular components — retrievers, generators, routers, tools — are assembled into explicit pipelines for RAG, agents and semantic search.

Hugging Face is the central platform of the open-source AI community — a hub for models, datasets, and demos, and the maintainer of widely used libraries like Transformers, Diffusers, and PEFT.

Central platform for openly shared AI models, datasets and demos — a kind of GitHub for machine-learning artifacts.

Jan is an open-source desktop application that lets you run large language models locally and fully offline on your own computer. It uses the llama.cpp engine and is positioned as a privacy-friendly ChatGPT alternative.

Open-source framework that chains LLMs with data sources, tools and memory into applications — arguably the best-known pipeline library for AI apps.

LangGraph is an open-source framework from LangChain for stateful, graph-based LLM workflows — nodes are functions or agents, edges define the control flow including loops and branches.

llama.cpp is an open-source C++ library for efficient LLM inference on CPU and GPU — the engine many local tools like Ollama and LM Studio are built on.

Llamafile is a Mozilla project that packages a local language model as a single executable file — model weights and inference engine in one. That file runs on several operating systems without installation.

Data framework for LLM applications, specialized in indexing, enriching and retrieving private data — at the core of many RAG architectures.

LM Studio is a desktop application for running LLMs locally with a graphical interface — including a model browser, chat interface and OpenAI-compatible server.

Make (formerly Integromat) is a cloud-based no-code workflow automation platform. Through a visual interface, you connect apps and APIs into multi-step workflows ("scenarios") without programming — for example to pass data between services.

Milvus is an open-source, distributed vector database for fast similarity search over large sets of embeddings. It is licensed under Apache 2.0 within the LF AI & Data Foundation; the main developer is the company Zilliz.

Ollama is a tool for running language models locally — Llama, Mistral or Qwen — operated via a CLI, with an OpenAI-compatible HTTP server for applications.

Open WebUI is an open-source chat interface for local and remote LLMs — a ChatGPT-like browser UX that runs as a Docker container and talks to Ollama, OpenAI-compatible APIs and more.

A global setting in Claude Code that controls how tool calls are handled: Plan (planning only), Default (asks for confirmation), Accept Edits (files free), Bypass (allow everything).

pgvector is an open-source PostgreSQL extension for vector search — adding embedding columns, distance functions, and ANN indexes (HNSW, IVFFlat) directly to an existing Postgres database.

Pinecone is a managed vector database service for RAG and semantic-search workloads — it stores embeddings, answers nearest-neighbour queries, and scales without the user operating the index themselves.

Qdrant is an open-source vector database written in Rust — it stores embeddings for semantic search, RAG and recommendation systems and runs locally, on your own cluster or as a managed cloud.

Hugging Face Spaces is a hosting platform for deploying and sharing interactive machine learning applications without your own server infrastructure. Apps become usable directly in the browser, for example via Gradio, Streamlit, Docker or static HTML.

TensorRT-LLM is an open-source library from NVIDIA that optimizes LLM inference on NVIDIA GPUs. It compiles models into highly optimized runtime engines and offers in-flight batching, a paged KV cache and quantization for high throughput at low latency.

Text-Generation-WebUI (oobabooga) is an open-source web interface for running LLMs locally. It bundles several inference backends, chat and completion modes and an OpenAI-compatible API under one common UI.

TGI (Text Generation Inference) is an open-source toolkit from Hugging Face for serving large language models efficiently. It provides a production-ready inference server with continuous batching, token streaming and optimised attention methods.

Open-source Python library from Hugging Face that gives unified access to thousands of pretrained models across text, vision and audio.

vLLM is an open-source high-throughput inference server for LLMs — known for PagedAttention, continuous batching, and an OpenAI-compatible API endpoint, widely used in production self-hosting setups.

Weaviate is an open-source vector database written in Go — it stores objects together with their embeddings, combines semantic and keyword (BM25) search and offers built-in vectorization, RAG and multi-tenancy.

whisper.cpp is an open-source C++ port of OpenAI's Whisper speech recognition — a compact native binary for local transcription on CPU, CUDA, Metal or Vulkan, with no Python dependency.

Windsurf is an AI IDE built on the VS Code base with a focus on agentic coding workflows — the Cascade agent plans and executes multi-step changes autonomously.

Zapier AI bundles the AI features of the automation platform Zapier — including Copilot for building workflows by language, autonomous agents, chatbots and an MCP server that exposes thousands of Zapier actions to external language models.