Platform Blueprint and Operating Playbook
This overview connects the factory's product thesis, capability model, reference architecture, reliability and security posture, learning system, adoption model, and success measures. It is a scope map, not a claim that every capability is
A focused view of boundaries, contracts, state, authority, failure paths, and tradeoffs drawn from this chapter.
End-to-end capability model
1. Intent and planning
Purpose: understand what the builder actually wants and determine a bounded, verifiable way to accomplish it.
| Capability | Responsibility |
|---|---|
| Intent recognition and goal interpretation | Translate the request into the actual outcome to be achieved. |
| Task decomposition and definition | Break complex work into explicit units that an agent or deterministic system can execute. |
| Planning and dependency mapping | Order work and make dependencies, parallelism, and blockers visible. |
| Acceptance criteria | Define observable conditions for done before execution. |
| Constraint identification | Capture technical, security, policy, time, cost, and resource boundaries. |
| Agent routing | Select an eligible agent or capability for each unit of work. |
| Dynamic replanning | Revise the plan when evidence or execution invalidates an assumption. |
2. Agent definitions
Purpose: define what an agent is, what it may do, and how its behavior is versioned and governed.
An Agent Definition contains its role, instructions, capabilities, policies, goals, permissions, tool access, eligible model configuration, autonomy level, escalation rules, and success criteria. It is configuration and provenance—not a credential and not permission to expand its own authority.
3. Agent harness
Purpose: provide the runtime infrastructure that allows bounded agents to perform useful work reliably.
The harness includes the runtime, execution loop, model abstraction and routing, context and context-window management, tools and MCP connections, state, memory, sandboxes, guardrails, human checkpoints, observability, error recovery, and orchestration.
The canonical execution loop is:
Understand → Plan → Act → Observe → Evaluate → Adjust
It repeats until the goal is verified, a stop condition is reached, the budget is exhausted, policy blocks progress, or a human decision is required.
4. Skills framework
Purpose: give agents reusable, standardized, versioned ways to perform work.
The framework covers coding, testing, debugging, deployment, security, repository, organization-specific, and workflow skills. It supports skill discovery, tool composition, versioning, evaluation, staged rollout, and retirement. A skill teaches a method; the harness still enforces authority.
5. Evaluation
Purpose: determine whether the work is correct, useful, safe, reliable, complete, and aligned with the original intent.
Evaluation covers task completion, intent alignment, correctness, code quality, functional behavior, security, policy compliance, regression safety, and quality trends. It combines deterministic evaluations—tests, compilers, linters, scanners, and policy checks—with bounded model-based review. Standard datasets benchmark candidates; production evaluations measure real workflows.
6. Feedback and self-improvement
Purpose: turn execution outcomes into measured improvements without allowing the runtime to silently rewrite its own controls.
This layer performs failure and root-cause analysis, learns from both successful and failed trajectories, and proposes improvements to strategy, skills, context, prompts, tools, routing, or policy. Eval-driven experiments and A/B or baseline-versus-candidate tests detect regression before promotion.
7. Software delivery
Purpose: connect agent execution to the governed engineering lifecycle.
Delivery includes repositories, isolated branches, pull requests, human and automated code review, CI/CD, unit/integration/end-to-end testing, static analysis, build verification, evidence gates, artifacts, deployment, rollback, release management, production validation, and production observability. A passing agent run is not a release decision.
Reference architecture
| Component | Owned responsibility | Critical evidence or control |
|---|---|---|
| Builder surfaces | Capture intent and present state, exceptions, evidence, and decisions | Authenticated intent, actor, version, and acceptance criteria |
| Intent and planning | Interpret goals, decompose work, map dependencies, and define done | Versioned plan, assumptions, constraints, risk, and criteria |
| Agent definitions | Declare role, behavior, capabilities, tools, permissions, models, and escalation | Versioned definition digest and approval state |
| Model gateway/router | Select an eligible execution resource without provider coupling | Catalog/policy version, alternatives, decision reason, route outcome |
| Context and memory | Provide the right trusted, scoped, fresh information at the right time | Source, classification, tenant, freshness, retrieval reason, and snapshot |
| Tools and MCP | Expose narrow actions and standardized integrations | Identity, schema, authorization, input/output digest, and revocation state |
| Skills | Package reusable task methods and tool composition | Version, owner, eval results, approved scope, and rollout state |
| Harness/runtime | Orchestrate the execution loop and enforce budgets and stop conditions | Execution manifest, state transitions, tool calls, checkpoints, and receipts |
| Execution sandbox | Isolate filesystem, network, processes, credentials, and resources | Environment attestation, grants, resource limits, and teardown proof |
| State and recovery | Preserve durable progress and safely resume or compensate | Idempotency keys, leases, checkpoints, retry lineage, and terminal state |
| Evaluation | Independently test the artifact and trajectory against criteria | Criterion-linked results, exact artifact identity, validator identity, and freshness |
| Feedback and learning | Convert outcomes into datasets and proposed changes | Dataset lineage, cohort, failure cluster, candidate, and experiment result |
| Policy engine | Decide whether an action or transition is allowed | Principal, capability, scope, policy version, decision, and reason |
| Observability | Explain behavior, reliability, cost, and failure without becoming authority | Correlation IDs, traces, events, SLOs, cost, and redacted audit records |
| Human approvals | Preserve accountable judgment for consequential actions and exceptions | Approver, subject version, evidence reviewed, decision, and expiry |
| Deployment | Govern artifact promotion, progressive release, verification, and rollback | Artifact provenance, environment, gates, rollout health, and outcome |
| Multi-tenancy | Prevent identity, data, memory, secrets, policy, and execution leakage | Tenant-scoped authorization and isolation tests |
| Adoption and versioning | Move teams to paved paths and evolve contracts without surprise | Usage, compatibility, migrations, deprecations, releases, and rollback plans |
Model gateway and routing policy
The router evaluates:
- task type and required capability;
- quality floor and historical performance on comparable tasks;
- latency objective and availability;
- estimated token and total execution cost;
- context-window requirement;
- security, privacy, residency, and data policy;
- tool-use and structured-output support; and
- fallback behavior when the preferred route is unavailable or degrades.
Selection follows two stages: first remove candidates that violate capability, security, availability, or quality requirements; then rank the eligible set by measured task performance, latency, and total cost. Fallback may relax cost or latency but never required capability, security, or policy. The routing unit is the complete agent configuration—model, instructions, context, tools, harness, and validators—not the model in isolation.
Harness reliability and production controls
The harness turns nondeterministic reasoning into bounded execution through:
- retries with classified, capped, and observable policies;
- durable checkpoints and resumable state;
- idempotency keys, leases, and duplicate-effect prevention;
- least-privilege permission and tenant boundaries;
- time, token, tool, compute, concurrency, and monetary budgets;
- explicit stop conditions and runaway-loop detection;
- per-provider, model, agent, tool, workflow, repository, and global kill switches;
- risk-based human approval gates;
- isolated execution and publication identities;
- state reconciliation after partial or ambiguous failure; and
- immutable evidence, provenance, and audit history.
These controls must cover production-agent failure, security incidents, reliability regression, model degradation, tool misuse, cost explosion, prompt injection, unauthorized repository or data access, failed deployments, evaluation regression, and model-provider outages.
Product and adoption operating model
Start with developers and one valuable, repeatable, reversible workflow. Expand to PM, QA, design, security, and other builders only after the common intent, evidence, and authority contracts are stable. Product requirements and the roadmap should be driven by builder problems and measured workflow gaps, not by the desire to expose every new model capability.
The operating model includes:
- product-line design partners and recurring builder interviews;
- forward-deployed engineers who help teams adopt the paved path and return implementation evidence to the platform team;
- internal champions with explicit feedback and escalation channels;
- weekly usage, reliability, cost, and failure reviews;
- controlled release experiments with baseline and candidate cohorts;
- paved paths for common workflows with migration support for existing teams;
- versioned contracts, compatibility windows, and a published deprecation strategy;
- internal go-to-market through documentation, onboarding, office hours, reference implementations, and evidence-backed success stories; and
- adoption and reliability dashboards segmented by product organization, persona, workflow, risk tier, and version.
Prioritization should favor the smallest capability that removes a measured builder constraint or closes a reliability, security, or evidence gap. Bespoke capabilities should be retired only after the paved path meets the use case and the team has a supported migration.
Review this chapter.
Challenge a claim, boundary, missing failure mode, unclear term, or unsupported evidence statement.
- Claim
- Boundary
- Failure
- Evidence