0% read on this device
Browse the curriculum

Start Here

Vision

First Principles

Operating Model

Domain Model

Agent Factory

Runtime Architecture

AI Engineering

Autonomous Workflows

Verification & Delivery

Factory Platform

Quality Engineering

Security & Governance

Case Studies

Labs

Interview Practice

Research Journal

Reference

Curriculum/Start Here/A focused view of boundaries, contracts, state, authority, failure paths, and tradeoffs drawn from this chapter.
Start Here16 min readchapter

Platform Blueprint and Operating Playbook

This overview connects the factory's product thesis, capability model, reference architecture, reliability and security posture, learning system, adoption model, and success measures. It is a scope map, not a claim that every capability is

Status: Canonical overviewRisk: variableLifecycle: intent · plan · execute · verify · deliver · learnContent reviewed 2026-08-25Maturity guide →
Claim boundaryThis is curriculum guidance. It does not by itself prove a production implementation.
architecture mode

A focused view of boundaries, contracts, state, authority, failure paths, and tradeoffs drawn from this chapter.

End-to-end capability model

1. Intent and planning

Purpose: understand what the builder actually wants and determine a bounded, verifiable way to accomplish it.

CapabilityResponsibility
Intent recognition and goal interpretationTranslate the request into the actual outcome to be achieved.
Task decomposition and definitionBreak complex work into explicit units that an agent or deterministic system can execute.
Planning and dependency mappingOrder work and make dependencies, parallelism, and blockers visible.
Acceptance criteriaDefine observable conditions for done before execution.
Constraint identificationCapture technical, security, policy, time, cost, and resource boundaries.
Agent routingSelect an eligible agent or capability for each unit of work.
Dynamic replanningRevise the plan when evidence or execution invalidates an assumption.

2. Agent definitions

Purpose: define what an agent is, what it may do, and how its behavior is versioned and governed.

An Agent Definition contains its role, instructions, capabilities, policies, goals, permissions, tool access, eligible model configuration, autonomy level, escalation rules, and success criteria. It is configuration and provenance—not a credential and not permission to expand its own authority.

3. Agent harness

Purpose: provide the runtime infrastructure that allows bounded agents to perform useful work reliably.

The harness includes the runtime, execution loop, model abstraction and routing, context and context-window management, tools and MCP connections, state, memory, sandboxes, guardrails, human checkpoints, observability, error recovery, and orchestration.

The canonical execution loop is:

Understand → Plan → Act → Observe → Evaluate → Adjust

It repeats until the goal is verified, a stop condition is reached, the budget is exhausted, policy blocks progress, or a human decision is required.

4. Skills framework

Purpose: give agents reusable, standardized, versioned ways to perform work.

The framework covers coding, testing, debugging, deployment, security, repository, organization-specific, and workflow skills. It supports skill discovery, tool composition, versioning, evaluation, staged rollout, and retirement. A skill teaches a method; the harness still enforces authority.

5. Evaluation

Purpose: determine whether the work is correct, useful, safe, reliable, complete, and aligned with the original intent.

Evaluation covers task completion, intent alignment, correctness, code quality, functional behavior, security, policy compliance, regression safety, and quality trends. It combines deterministic evaluations—tests, compilers, linters, scanners, and policy checks—with bounded model-based review. Standard datasets benchmark candidates; production evaluations measure real workflows.

6. Feedback and self-improvement

Purpose: turn execution outcomes into measured improvements without allowing the runtime to silently rewrite its own controls.

This layer performs failure and root-cause analysis, learns from both successful and failed trajectories, and proposes improvements to strategy, skills, context, prompts, tools, routing, or policy. Eval-driven experiments and A/B or baseline-versus-candidate tests detect regression before promotion.

7. Software delivery

Purpose: connect agent execution to the governed engineering lifecycle.

Delivery includes repositories, isolated branches, pull requests, human and automated code review, CI/CD, unit/integration/end-to-end testing, static analysis, build verification, evidence gates, artifacts, deployment, rollback, release management, production validation, and production observability. A passing agent run is not a release decision.

Reference architecture

ComponentOwned responsibilityCritical evidence or control
Builder surfacesCapture intent and present state, exceptions, evidence, and decisionsAuthenticated intent, actor, version, and acceptance criteria
Intent and planningInterpret goals, decompose work, map dependencies, and define doneVersioned plan, assumptions, constraints, risk, and criteria
Agent definitionsDeclare role, behavior, capabilities, tools, permissions, models, and escalationVersioned definition digest and approval state
Model gateway/routerSelect an eligible execution resource without provider couplingCatalog/policy version, alternatives, decision reason, route outcome
Context and memoryProvide the right trusted, scoped, fresh information at the right timeSource, classification, tenant, freshness, retrieval reason, and snapshot
Tools and MCPExpose narrow actions and standardized integrationsIdentity, schema, authorization, input/output digest, and revocation state
SkillsPackage reusable task methods and tool compositionVersion, owner, eval results, approved scope, and rollout state
Harness/runtimeOrchestrate the execution loop and enforce budgets and stop conditionsExecution manifest, state transitions, tool calls, checkpoints, and receipts
Execution sandboxIsolate filesystem, network, processes, credentials, and resourcesEnvironment attestation, grants, resource limits, and teardown proof
State and recoveryPreserve durable progress and safely resume or compensateIdempotency keys, leases, checkpoints, retry lineage, and terminal state
EvaluationIndependently test the artifact and trajectory against criteriaCriterion-linked results, exact artifact identity, validator identity, and freshness
Feedback and learningConvert outcomes into datasets and proposed changesDataset lineage, cohort, failure cluster, candidate, and experiment result
Policy engineDecide whether an action or transition is allowedPrincipal, capability, scope, policy version, decision, and reason
ObservabilityExplain behavior, reliability, cost, and failure without becoming authorityCorrelation IDs, traces, events, SLOs, cost, and redacted audit records
Human approvalsPreserve accountable judgment for consequential actions and exceptionsApprover, subject version, evidence reviewed, decision, and expiry
DeploymentGovern artifact promotion, progressive release, verification, and rollbackArtifact provenance, environment, gates, rollout health, and outcome
Multi-tenancyPrevent identity, data, memory, secrets, policy, and execution leakageTenant-scoped authorization and isolation tests
Adoption and versioningMove teams to paved paths and evolve contracts without surpriseUsage, compatibility, migrations, deprecations, releases, and rollback plans

Model gateway and routing policy

The router evaluates:

  • task type and required capability;
  • quality floor and historical performance on comparable tasks;
  • latency objective and availability;
  • estimated token and total execution cost;
  • context-window requirement;
  • security, privacy, residency, and data policy;
  • tool-use and structured-output support; and
  • fallback behavior when the preferred route is unavailable or degrades.

Selection follows two stages: first remove candidates that violate capability, security, availability, or quality requirements; then rank the eligible set by measured task performance, latency, and total cost. Fallback may relax cost or latency but never required capability, security, or policy. The routing unit is the complete agent configuration—model, instructions, context, tools, harness, and validators—not the model in isolation.

Harness reliability and production controls

The harness turns nondeterministic reasoning into bounded execution through:

  • retries with classified, capped, and observable policies;
  • durable checkpoints and resumable state;
  • idempotency keys, leases, and duplicate-effect prevention;
  • least-privilege permission and tenant boundaries;
  • time, token, tool, compute, concurrency, and monetary budgets;
  • explicit stop conditions and runaway-loop detection;
  • per-provider, model, agent, tool, workflow, repository, and global kill switches;
  • risk-based human approval gates;
  • isolated execution and publication identities;
  • state reconciliation after partial or ambiguous failure; and
  • immutable evidence, provenance, and audit history.

These controls must cover production-agent failure, security incidents, reliability regression, model degradation, tool misuse, cost explosion, prompt injection, unauthorized repository or data access, failed deployments, evaluation regression, and model-provider outages.

Product and adoption operating model

Start with developers and one valuable, repeatable, reversible workflow. Expand to PM, QA, design, security, and other builders only after the common intent, evidence, and authority contracts are stable. Product requirements and the roadmap should be driven by builder problems and measured workflow gaps, not by the desire to expose every new model capability.

The operating model includes:

  • product-line design partners and recurring builder interviews;
  • forward-deployed engineers who help teams adopt the paved path and return implementation evidence to the platform team;
  • internal champions with explicit feedback and escalation channels;
  • weekly usage, reliability, cost, and failure reviews;
  • controlled release experiments with baseline and candidate cohorts;
  • paved paths for common workflows with migration support for existing teams;
  • versioned contracts, compatibility windows, and a published deprecation strategy;
  • internal go-to-market through documentation, onboarding, office hours, reference implementations, and evidence-backed success stories; and
  • adoption and reliability dashboards segmented by product organization, persona, workflow, risk tier, and version.

Prioritization should favor the smallest capability that removes a measured builder constraint or closes a reliability, security, or evidence gap. Bespoke capabilities should be retired only after the paved path meets the use case and the team has a supported migration.

External review

Review this chapter.

Challenge a claim, boundary, missing failure mode, unclear term, or unsupported evidence statement.

  • Claim
  • Boundary
  • Failure
  • Evidence