Start Debugging

llm

85 posts · Page 2 of 9

Retry and Backoff for Long Agent Loops Under Overloaded and Rate-Limit Errors

The Anthropic SDK retries a failed call twice in about 1.2 seconds, which is fine for a chat request and wrong for a 200-turn agent run. Classify every failure into retry-after, capacity, transient or terminal, retry the model turn (never the tool call), share one pause gate across workers, catch the mid-stream overloaded_error that arrives as a 200, and checkpoint so a dead run resumes. Tested against anthropic 2.3.0 for Python.

Migrate a Coding Agent from Claude Sonnet 4.6 and Opus 4.7 to the 5.5 Family: Model IDs, Effort, and Cost

Moving an agent from claude-sonnet-4-6 or claude-opus-4-7 to claude-sonnet-5-5 or claude-opus-5-5 is not just a model ID swap. Thinking is always on, thinking-off and forced tool_choice now return 400, the effort defaults moved, Sonnet counts about 30% more tokens, and Claude Code ignores your old effortLevel on Opus 5.5. Here is the full checklist with before/after code.

What Is Magentic Orchestration in Microsoft Agent Framework

Magentic orchestration is Agent Framework's port of AutoGen's Magentic-One: an LLM manager writes a fact sheet and plan (the task ledger), then grades every round with a JSON progress ledger to pick the next agent, detect stalls and replan. Here is how the loop works on Microsoft.Agents.AI.Workflows 1.24.0 and agent-framework-orchestrations 1.3.1, what it costs per round, and the limit defaults that let it run forever.

What Is the Agent Harness in Microsoft Agent Framework

The Agent Harness is Microsoft Agent Framework's batteries-included runtime: one call (AsHarnessAgent in .NET, create_harness_agent in Python) wraps any chat client in a tool loop with todos, plan/execute modes, file memory, tool approval, compaction and OpenTelemetry. Here is what it actually sends to the model on Microsoft.Agents.AI.Harness 1.23.0, what it costs per call, and how to trim it.

What Is Tool Calling and Why JSON Schemas Matter More Than Prompts

Tool calling is a protocol, not magic: the model emits a structured request matching a JSON Schema you supplied, your code runs it, and the result goes back as a message. The schema and its descriptions are rendered into the model's prompt and, with strict mode, into a decoding grammar, so they shape behaviour more reliably than any system-prompt instruction. Here is how it works on claude-sonnet-5-5 and OpenAI strict mode, with schema patterns that make invalid calls impossible.

What Is the Difference Between an AI Agent and an AI Workflow?

In a workflow, your code decides the next step and the model fills in each step. In an agent, the model decides the next step and your code only executes it. That one question (who owns the control flow) determines cost, latency, testability and failure modes. Here is the distinction as Anthropic, Microsoft Agent Framework and LangGraph define it, with the same task built both ways in Python against claude-haiku-4-5 and claude-sonnet-5-5.
Prev Next