Tag: reliability

All the articles with the tag "reliability".

• Engineering Around the Model: Harnesses, Loops, Graphs and the Definition of Done

  Updated:18 Oct, 2026

  The model sets the ceiling; the harness around it decides how close an agent gets. The parts of a harness; loop design (stopping conditions, retries, budgets); graphs and when they beat a loop; and the definition of done as a check the harness runs instead of a claim the model makes. Measured on a small agent: a verifier that checks only where the answer came from, against the same agent without it, with success at each step budget; and what Anthropic's long-running harnesses do about agents that declare victory early.

• Chain-of-Thought and Prompt Chaining

  Updated:16 Oct, 2026

  Asking a model for intermediate steps buys serial computation it can't do in one forward pass, and splitting a task into a chain of calls makes those steps inspectable and checkable. Why one forward pass is a fixed-depth circuit, zero-shot and few-shot chain-of-thought, self-consistency, chains with validation between steps, and how errors compound. Then a 1.5B model on problems of 1 to 8 serial steps, answered directly, reasoned in one call, chained one step per call, and chained with each step checked.