Start Debugging

Tag: prompt-caching

4 posts

2026-05-18 errors ai-agents llm

Fix: rate_limit_error on Claude Sonnet 4.6 in a Long Agent Loop

A 429 rate_limit_error on claude-sonnet-4-6 in a long agent loop is almost always ITPM, not RPM. Read retry-after, cache the system prompt, and gate on anthropic-ratelimit-input-tokens-remaining. Step-by-step fix with code.

2026-05-14 claude-code mcp ai-agents

How to Add Retrieval-Augmented Generation to a Claude Code Session

A 2026 walkthrough for wiring RAG into Claude Code 2.1.x: when agentic grep stops scaling, how to attach a hybrid BM25 + dense vector MCP server, how to wrap a retrieval CLI in a custom skill, and how Anthropic's contextual embeddings technique pushes recall above 92%. Anchored to claude-sonnet-4-6, claude-opus-4-7, and Claude Context 0.x.

2026-05-12 llm ai-agents claude-code

How to Cache Multi-Turn Claude Conversations Across API Calls

Place rolling cache_control breakpoints across messages, respect the 20-block lookback, and refresh the 5-minute TTL automatically so a 50-turn agent loop pays the prefix once, not fifty times. Verified against anthropic 0.42 (Python) and @anthropic-ai/sdk 0.30 (Node) in May 2026.

2026-04-29 llm ai-agents anthropic-sdk

How to Add Prompt Caching to an Anthropic SDK App and Measure the Hit Rate

Add prompt caching to a Python or TypeScript Anthropic SDK app, place cache_control breakpoints correctly, and read cache_read_input_tokens and cache_creation_input_tokens to compute a real hit rate. With pricing math for Claude Sonnet 4.6 and Opus 4.7.