Function Calling / Tool Use
How an LLM uses tools: define a tool as a schema, the model picks the function and arguments, the result returns to the chat — the basis of every agent.
Redaktion
Praktische Aspekte der LLM-API-Nutzung — Streaming, Caching, Rate Limits.
How an LLM uses tools: define a tool as a schema, the model picks the function and arguments, the result returns to the chat — the basis of every agent.
Practical API mechanics beyond pricing: streaming for UX, prompt caching against token cost, the Batch API for bulk jobs, rate limits without 429 drama.