API-Nutzung

GDPR-compliant LLM use describes the data-protection-compliant use of large language models such as ChatGPT, Claude or Gemini in a company — with a legal basis, data processing agreement, controlled input of personal data, EU hosting and training opt-out.

Regulation (EU) 2024/1689 is the EU's first comprehensive law on artificial intelligence. It regulates AI systems by risk in four tiers, from prohibited practices to minimal risk, and sets obligations for providers and deployers.

Processing on behalf occurs when a service provider processes personal data for a controller, bound by instructions. The Data Processing Agreement (DPA) under Art. 28 GDPR governs the mandatory terms of this arrangement.

US law from 2018 (Clarifying Lawful Overseas Use of Data Act). US authorities can compel US providers to hand over data even when it is stored outside the US — for example in the EU. It conflicts with the GDPR.

Data residency refers to the physical storage and processing location of data — the geographic region or country where the servers sit. It says nothing about which legal jurisdiction may access that data.

Standard pricing unit for AI APIs — cost in US dollars per one million processed tokens. Listed separately for input, output and sometimes cache.

Tokens you send to an AI model in an API call — your prompt, the context, attached documents. Billed separately from output tokens and usually much cheaper.

Tokens an AI model produces as its response. Billed separately and usually three to five times more expensive than input tokens because the model has to actively generate them.

Asynchronous API mode that collects many requests and processes them at a significant discount — results are typically delivered within 24 hours.

A keyword glossary for Speech-to-Text is a short, curated list of project-specific terms, brand and product names handed to an STT model as a context hint before transcription — typically through Whisper's `initial_prompt`.

Prompt caching is an API feature in which a provider stores recurring prompt prefixes — making subsequent requests cheaper and faster because the cached portion is not reprocessed.

Provider-enforced cap on requests or tokens per time window — it protects infrastructure and ensures fair usage across customers.

Tiered model line-up from a provider — small fast variants (Mini/Flash/Haiku) at a fraction of the price of the big frontier models. Also: volume tiers with quantity discounts.

TPM (tokens per minute) and RPM (requests per minute) are the two common units in which AI API providers express their rate limits — TPM caps the token volume, RPM caps the number of requests per minute.

The `initial_prompt` parameter lets you pass Whisper a keyword list or sample sentence before transcription. The model treats this text as context and recognises the included terms far more reliably.

Streaming means transmitting an LLM's response token by token in real time — the user sees the text word by word rather than only after the full generation completes.