AI Concepts

The fundamentals and mechanics behind modern language models and AI workflows — from LLM basics through prompting, agents and RAG to local models, fine-tuning, evaluation and API usage.

AI Concepts is the topic field beneath the surface: not which model you pick, but how modern language models actually work and how you assemble them into reliable tools. Once you understand the mechanics, you make better decisions — and run into hallucinated answers, blown budgets and systems that shine in a demo but fail in everyday use far less often.

It starts with the LLM basics: tokens, the context window, next-token prediction and the difference between probability and truth. Prompting builds on that — steering the model through its input alone. Good prompts are not magic spells but clear instructions, examples and structural cues that guide the output into predictable paths.

From a single call to a system

A single prompt is rarely enough. Agents are autonomous, multi-step systems: the model plans, calls tools, reads their results and decides on the next step — until the task is done. So a model doesn’t only draw on its training knowledge, RAG (Retrieval-Augmented Generation) comes into play: your own documents are split into chunks, stored as embeddings in a vector database, retrieved to match the query and sorted via reranking before they enter the model as context. That way the AI answers based on your data, not on guesses.

Running, adapting, checking

If you need data protection or cost control, you look at local LLMs — here concepts like model formats, quantization (compression at the cost of minimal accuracy) and the right hardware matter. Training & fine-tuning goes a step further: a base model is specialised on your own data or tasks. And because quality can’t be guessed, evaluation belongs here — evals, benchmarks and LLM judges that measure whether changes are really an improvement. The technical frame is API usage: streaming for smooth output, caching to save on recurring contexts and rate limits you have to plan for in production.

What you’ll find on this page

Below you’ll find a topic world around AI concepts: current news on new methods and tools, blog articles with background and practice, lexicon articles for deeper insight and a glossary of the most important terms. Use the filters above to jump straight to a sub-topic — from prompting through agents and RAG to evaluation.


Blog

Why AI Models Find Different Code Problems

Three frontier models, the same 1000-line script, three different finding lists — and why that very spread makes multi-orchestration strong.

Martin Rau
GDPR-Compliant LLM Use Ensemble / Multi-Model Orchestration EU AI Act (KI-Verordnung) Agent Skills Attention Mechanism Data Processing on Behalf (DPA) Cloud Act Reasoning Effort S-RAG Data Residency Ground Truth Recall Sampling (LLM) Thinking Budget Automatic Speech Recognition (ASR) $/MTok (Cost per Million Tokens) Input Token Output Token Path Dependency (LLM Output) Whisper Agentic RAG AI Agent Audio normalization AutoGPT Batch API Benchmark (AI) Browser Use Chain-of-Thought Chunking Computer Use Constitutional AI Context Engineering Context Precision Context Recall Context window Contextual Retrieval Cosine Similarity dBFS, Headroom & Clipping DPO (Direct Preference Optimization) Embedding Evals Faithfulness Few-Shot Prompting Fine-Tuning Function Calling GGUF GraphRAG Guardrails Hallucination Hybrid Search HyDE Indirect Prompt Injection Inference Jailbreak Keyword Glossary (STT) KV Cache LLM LLM-as-a-Judge LoRA MCP Meta-Prompting PEFT (Parameter-Efficient Fine-Tuning) Prompt Caching Prompt engineering Prompt Injection Prompt Leaking Prompt Template QLoRA Quantization Query Expansion RAG RAGAS Rate Limit (AI) ReAct (Prompting) Reranking RLHF Role Prompting Self-Consistency Self-Refine Semantic Search SFT (Supervised Fine-Tuning) Spotlighting Stop Sequences Structured Output / JSON Mode Synthetic Data System Prompt Temperature Tier Pricing Token Tokenizer Tool Call Top-p / Top-k TPM/RPM Tree of Thoughts Vector Database VRAM Whisper initial_prompt XML tags in the prompt Adapter (PEFT) Batch Inference Catastrophic Forgetting Continued Pretraining Instruction Tuning Knowledge Distillation Model Card ORPO (Odds Ratio Preference Optimization) Prefix Tuning Safetensors Streaming (LLM) Zero-Shot