Building AI Agents — From Tool Use to Multi-Agent Systems
How AI agents work: from a single tool call through MCP, structured outputs and LangGraph to the question of when multi-agent setups actually pay off.
Grundbegriffe und Mechanik moderner Sprachmodelle und KI-Workflows.
How AI agents work: from a single tool call through MCP, structured outputs and LangGraph to the question of when multi-agent setups actually pay off.
An embedding is a vector of numbers that places meaning in space. Why similar content sits close together and what embeddings are used for.
When fine-tuning pays off, which methods exist (SFT, DPO, LoRA, QLoRA), and what AMD vs. NVIDIA hardware actually means in practice.
How an LLM uses tools: define a tool as a schema, the model picks the function and arguments, the result returns to the chat — the basis of every agent.
Why LLMs confidently invent falsehoods, what types of hallucinations exist, and which remedies actually help — RAG, source enforcement, verification.
How to tell whether an LLM system actually works: three evaluation layers from benchmarks to CI evals, plus pitfalls like Goodhart and judge bias.
How prompt injection, prompt leaking, and jailbreaks work — and which defenses (guardrails, spotlighting, sanitization) actually help.
Zero-shot, few-shot, chain-of-thought, tree of thoughts, ReAct & co. — when each prompting technique pays off and how they fit together.
How to steer retrieval on purpose: embedding choice, hybrid weights, reranker cascades, time decay, authority boost, MMR and MCP as a retrieval tool.
How to run language models on your own hardware — VRAM requirements, tooling (Ollama, LM Studio, llama.cpp, vLLM) and which models fit which GPU.
How an LLM picks the next token: temperature sharpens or flattens the probabilities, top-p and top-k limit the choice. Which setting for what.
What the context window is, how big modern windows are, the lost-in-the-middle phenomenon, cost and latency, and the distinction from RAG and long-term memory.
What a token is, how tokenizers split text, and why tokens drive cost, context window, and speed — with rules of thumb for estimating token counts.
How a RAG pipeline works: embedding, vector DB, retrieval, reranking, prompt — and which pitfalls show up in practice.
Practical API mechanics beyond pricing: streaming for UX, prompt caching against token cost, the Batch API for bulk jobs, rate limits without 429 drama.