Category: AI Coding Workflows

Step-by-step workflows for using AI to plan features, write code, debug issues, refactor systems, generate tests, review pull requests, document projects, migrate codebases, and ship software.

  • How the OpenAI Codex Team Builds Codex With 10-Bullet Specs

    How the OpenAI Codex Team Builds Codex With 10-Bullet Specs

    The OpenAI Codex team is not merely building an AI coding agent. It is also using that agent to compress the way product work gets done: product managers submit pull requests, designers write production code, engineers explore requirements directly against the repository, and formal specifications are reserved for the coordination problems that genuinely need them.

    That is the central lesson from a 43-minute Behind the Craft interview with Codex product lead Alexander Embiricos and OpenAI developer-experience lead Romain Huet. The most repeated headline from the conversation—“the entire Codex product has a ten-bullet spec”—is too strong. What Embiricos actually said was that the team writes very few specs and, when one is needed, it may be only “like 10 bullets or something.”

    The distinction matters. The Codex approach is not “never document.” It is to delay documentation until the work exceeds what one empowered owner, working with an agent, can understand and execute.

    Original English illustration introducing a Codex team tutorial
    The original WeChat article framed the interview as a tutorial from the Codex team. Source artwork preserved for provenance.

    What the OpenAI Codex Team Revealed

    The interview describes an operating model built around five linked ideas:

    1. Write a spec only when complexity or coordination requires one.
    2. Plan concrete work for no more than about eight weeks, while keeping a looser long-term direction.
    3. Let the people closest to the code make more decisions.
    4. Treat product management as missing-work coverage, not automatic command authority.
    5. Hire for agency and evidence of shipped work.

    These are statements about one unusually technical, fast-growing team. Some details—such as the approximate team size or comparisons between designer and engineer output—are anecdotes from the speakers, not independently audited productivity metrics. The useful question is therefore not whether every company should copy Codex, but which conditions make this model viable.

    Behind the Craft interview thumbnail featuring Peter Yang, Alexander Embiricos, and Romain Huet
    Peter Yang interviewed Codex product lead Alexander Embiricos and developer-experience lead Romain Huet. Watch the original conversation on YouTube.
    Five lessons from the OpenAI Codex team about specs, planning, team structure, product management, and hiring
    Five operating principles discussed in the interview. The team-size and PM-count figures are approximate interview statements.

    Why Codex Uses 10-Bullet Product Specs

    Traditional product development often separates discovery, requirements, design, implementation, and validation among several roles. Each handoff creates a need for more explicit documentation. Codex changes the economics of those handoffs because a single person can ask an agent to inspect the repository, trace dependencies, propose options, implement a small change, run tests, and prepare a pull request.

    Embiricos said the team writes a spec when the problem becomes too large for one person to hold in their head or when several people need to coordinate. Even then, the document can be extremely short. The objective is not completeness for its own sake; it is enough shared context to unblock a decision.

    Huet demonstrated the same principle through Codex Plan Mode. He pointed the agent at an iOS project and asked what the team should build next. Rather than starting from a blank planning template, the agent inspected the actual codebase and proposed directions grounded in the product’s current state.

    This shifts product discovery closer to executable evidence. A plan can be challenged against code, tests, interfaces, and technical constraints before a large group commits to it.

    Comparison of a traditional long specification with a concise ten-bullet specification
    The interview does not claim that one ten-bullet document specifies all of Codex. It says the team writes few specs and keeps them short when they are needed.

    How PMs and Designers Use Codex to Explore Ideas

    Embiricos described three practical modes for a product manager:

    • For a small change, submitting a good pull request may be faster than negotiating for engineering priority.
    • For a medium-size change, Codex can produce an implementation plan for review.
    • For a vague or complex idea, the agent can explore the repository and help the PM build a mental model—even if the generated implementation is never shipped.

    That third mode is the most important. The output is not always code. It can be better questions, clearer trade-offs, or an explanation that helps an engineer understand why a direction matters.

    The interview also claims that Codex designers now contribute more code than an engineer did six months earlier. That should be read as a qualitative observation from the product lead, not a benchmark. The broader point is credible: once generating a working change becomes easier, role boundaries move. The scarce work becomes selecting the right change, defining quality, reviewing behavior, and owning the result.

    The team says most of its code is agent-generated, yet it does not present this as carefree “vibe coding.” Humans still provide system design, judgment, verification, and accountability. Teams adopting the same pattern need authority controls for AI coding agents so that faster execution does not silently expand risk.

    Three ways a product manager uses Codex for small changes, plans, and mental-model exploration
    Codex can be an implementation tool, a planning tool, or a way to explore a problem before handing the insight to an engineer.

    Why OpenAI Plans for Eight Weeks—or the Distant Future

    Embiricos relayed advice from an OpenAI researcher named Andre: plan near term or long term, but avoid the middle. He described near-term planning as a concrete goal with an absolute maximum horizon of roughly eight weeks. Long-term planning is more directional: assume models become more capable, more tasks can be delegated, and many agents can work in parallel.

    The missing middle is a conventional feature roadmap. When model behavior changes rapidly, a detailed six-month sequence can encode assumptions that expire before the work begins.

    This was presented as advice that shaped the Codex team—not as a formally published OpenAI policy. It also has limits. A regulated product, hardware program, enterprise migration, or multi-party launch may require commitments far beyond eight weeks. The transferable principle is to match planning detail to the stability of the underlying constraints.

    Codex team planning frame covering near-term goals, no fixed medium-term roadmap, and long-term direction
    A useful planning frame for a rapidly changing model layer: specific near-term commitments and a flexible long-term direction.

    How Parallel Agents Led to the Codex App

    The Codex desktop app illustrates how product direction, model capability, and user behavior interacted.

    OpenAI released GPT-5.2-Codex on December 18, 2025, describing it as optimized for long-horizon work, context compaction, large refactors, and reliable long-running tasks. Embiricos said this generation crossed an important practical threshold: users could delegate longer tasks and expect more one-shot completions.

    Advanced users responded by running many terminal sessions in parallel. In the interview, Embiricos approximated one widely shared setup as “like 18 terminals” across three displays. The desktop app made that multi-agent pattern visible and manageable for people who would not build a tmux command center.

    But model progress did not create the app idea from nothing. Embiricos also described discussing a delegation-oriented interface with Peter Steinberger in October, before GPT-5.2-Codex shipped. The more accurate causal story is that better models and observable power-user behavior validated and accelerated an existing direction.

    OpenAI launched the Codex app for macOS on February 2, 2026, later adding Windows. The official launch post said Codex usage had doubled since the mid-December model release and that more than one million developers had used Codex in the preceding month. By March 19, OpenAI reported more than two million weekly active Codex users.

    Transition from many parallel terminal windows to parallel agents in the Codex App
    The app productized a power-user pattern: several delegated coding tasks progressing in parallel.

    Why Power Users Shape the Product Roadmap

    Codex is unusually exposed to its most advanced users because its core is open source. Users can inspect code, enable experimental behavior, fork the project, and develop workflows before the product team has simplified them for a broader audience.

    That makes power users an early-warning system for product demand. It can also make the product inaccessible if every advanced control is promoted into the default interface.

    The team’s answer is layered design: keep the core interaction minimal, provide sensible standard behavior, and let experts discover configuration, forks, and experimental features over time. The metaphor in the interview was a game that reveals deeper mechanics as the player progresses.

    This is a stronger strategy than simply copying whatever power users do. The team watches the frontier, identifies repeated behavior, then decides which parts deserve a safer and simpler product surface.

    Layered Codex product design with a minimal core, standard features, and power-user configuration
    Layering lets experts reach advanced controls without forcing every new user to understand them on day one.

    Inside the Codex Team's “Pirate Ship” Operating Model

    When Yang suggested the Codex group had roughly 50 to 100 people, Embiricos said that sounded about right. He also said the rapidly growing team had only recently added a second product manager and intentionally operated a little like a “pirate ship,” with limited cross-functional alignment and simple reporting lines.

    He described switching between two modes. In execution mode, he uses Codex to understand feedback, inspect the repository, prepare changes, and help the team launch. In coordination mode, he spends more time forming direction and communicating trade-offs.

    This structure works partly because the builders are also users. Engineers, designers, and PMs can evaluate the product through daily experience, while an active open-source community supplies constant external feedback. A team serving unfamiliar users, complex buyers, or multiple regulated stakeholders cannot assume the same degree of shared intuition.

    Pirate ship metaphor for the Codex team's lean cross-functional operating model
    The “pirate ship” is a speaker metaphor, and the 50–100-person range is approximate—not a formal organization chart.

    Codex as a Developer-Platform Entry Point

    Huet argued that Codex is becoming an entry point to the broader OpenAI developer platform. Instead of publishing only hand-written integration guides, developer-experience teams can package knowledge as Skills and teach builders to use Codex to work with image generation, Sora, speech-to-speech systems, APIs, and external tools such as Linear.

    This idea expands Codex from a code generator into an orchestration surface: the agent can read documentation, modify an application, run commands, and connect the developer’s intent to several platform capabilities.

    The architecture supports that direction. The open-source Codex repository is primarily Rust, and its documented core contains shared business logic. The app-server documentation says it powers rich interfaces such as the VS Code extension. In the interview, Huet said the desktop app, IDE extension, and CLI communicate with the same open-source harness.

    For readers who want the command-line foundation, the Codex CLI guide explains the lower-level workflow. Teams coordinating several agents should also consider a file-first multi-agent collaboration protocol so that parallel work remains inspectable.

    Codex and Skills as an entry point to image, video, speech, API, Linear, and coding workflows
    Huet described Codex plus Skills as a practical way to teach developers to use a wider platform.

    Is AI Eliminating the Product Manager Role?

    Embiricos offered the interview’s most provocative position: he sees product management as a gap-filling role rather than inherently a leadership role. As agents let engineers, designers, and PMs perform more of one another’s work, the gaps change.

    The useful interpretation is not “fire every PM.” Embiricos explicitly preserved a place for people who spend serious time with users, understand a market, and operate in a sufficiently large organization. Every problem still needs an owner; the owner does not always need the PM title.

    Huet recalled that Stripe reached about 250 employees with no PMs before modern AI tools, because engineers were building an API they personally wanted to use. That is an interview recollection rather than a separately audited staffing record, but it highlights the dependency: the closer builders are to users and the product, the less translation work is required.

    AI compresses the talent stack most effectively when people possess judgment outside their original role. A PM who can inspect code, a designer who can ship an implementation, and an engineer who can interview customers can make decisions with fewer handoffs. But eliminating coordination without distributing those skills merely hides the work.

    Comparison between a traditional product manager and a gap-filling product manager
    The gap-filler framing is conditional: customer insight and coordination remain essential in large or unfamiliar markets.

    What Other Product Teams Can—and Cannot—Copy

    Most teams can copy the mechanics before copying the organization:

    • Give one owner an agent and access to the real repository.
    • Ask for a plan grounded in code before scheduling a large planning meeting.
    • Let non-engineers prepare small, reviewable pull requests.
    • Keep near-term goals concrete and revise medium-term assumptions frequently.
    • Separate agent speed from human approval, testing, security, and ownership.
    • Observe advanced user workflows, then productize only repeated and valuable patterns.

    What they should not copy blindly is the staffing ratio or lack of formal coordination. Codex benefits from technical users, employees who use their own product, an open-source feedback loop, strong model expertise, and a platform changing quickly enough to punish rigid roadmaps. A healthcare workflow, enterprise procurement product, or consumer service for unfamiliar users has different constraints.

    The right experiment is small and measurable: choose one bounded feature, let a cross-functional owner use Codex from discovery through pull request, and compare lead time, defects, review burden, and user outcome with the existing process.

    A Practical AI-First Product Development Playbook

    An AI-first workflow inspired by the OpenAI Codex team can be expressed as seven steps:

    1. Start from the repository. Let the agent inspect current behavior before proposing a feature.
    2. Name one accountable owner. The agent can execute tasks, but a person owns the decision and result.
    3. Use the lightest useful artifact. A short plan or ten bullets may be sufficient; add detail only when coordination requires it.
    4. Delegate exploration before implementation. Ask the agent for alternatives, dependencies, tests, and failure modes.
    5. Keep work bounded and verifiable. Use clear permissions, tests, review gates, and rollback paths.
    6. Share the mental model. Preserve the reasoning and trade-offs, not only the generated patch.
    7. Measure outcomes, not code volume. Faster code generation matters only if the team ships the right behavior at acceptable quality.

    That approach also explains the team’s hiring preference. Embiricos emphasized links, ideas, agency, and visible work over credentials. Agent leverage rewards people who notice an important problem, learn what they need, and carry the work through verification.

    Hiring comparison favoring shipped work, projects, ideas, and agency over credentials
    “Show me what you built” summarizes the interview’s preference for agency and demonstrated work.

    Conclusion

    The OpenAI Codex team offers a compelling preview of product development after code generation becomes cheap. Specifications shrink because exploration happens against the codebase. Roles blur because more people can make working changes. Planning becomes shorter because the model layer moves quickly. Product management shifts toward whichever gaps still require human judgment.

    The model is powerful, but it is not universal. Its success depends on technically fluent builders, direct contact with users, strong verification, and clear ownership. The durable lesson is not “use exactly ten bullets.” It is to remove coordination that no longer creates value while making accountability more explicit wherever an agent increases execution speed.

    This article is a substantially rewritten English analysis based on BaoyuAI's original WeChat article, “Interview: How the Codex Team Uses Its Own Product to Build Codex”, the original interview, and the primary sources below.

    Primary Sources

    Frequently Asked Questions

    Does the entire Codex product have one 10-bullet spec?

    No. Embiricos said the team writes very few specs and that a spec, when needed, may be roughly ten bullets. He did not say one ten-bullet document specifies the entire product.

    Does the Codex team have no product managers?

    No. The interview said the team had only recently added a second PM. The broader argument was that product ownership and leadership do not automatically have to belong to a PM.

    Did GPT-5.2-Codex create the Codex app idea?

    Not by itself. The team was already discussing a delegation-oriented interface before the model launched. Better long-horizon capability and visible parallel-terminal workflows helped validate and accelerate the app.

    Can any company replace its roadmap with eight-week plans?

    Not safely. The approach fits a rapidly changing software and model environment. Products with regulatory, hardware, contractual, or multi-company dependencies may require longer commitments and more formal documentation.

    What is the most transferable lesson from the OpenAI Codex team?

    Put planning and implementation closer together. Give a responsible owner access to the real codebase, use agents to explore and execute, and add documentation or coordination only when complexity justifies it.

  • Comet 0.4 Guide: Classic Spec Workflows, /comet-any and Skill Evaluation

    Comet 0.4 Guide: Classic Spec Workflows, /comet-any and Skill Evaluation

    Comet began as an orchestration layer for combining OpenSpec’s specification lifecycle with Superpowers-style planning and execution. The project now describes itself more broadly: a resumable workflow and Skill platform for coding. That shift matters because current Comet has three distinct jobs, not one:

    1. /comet runs a guarded software-change workflow.
    2. /comet-any turns existing Skills into a reusable workflow package.
    3. comet eval tests whether a Skill behaves reliably enough to advance toward publication.

    A June 2026 WeChat article from 职场向上生长力 explains the original five-phase design well. It is now a historical snapshot of the 0.3.x line: its central state-machine model remains relevant, but several counts, scripts and product boundaries changed in the 0.4 beta series. This guide uses the current official rpamis/comet repository and release metadata as the authority.

    Version reality: current does not mean stable

    Release channel map distinguishing Comet 0.3.9 from the current 0.4 beta and the stable Classic core
    Classic is the established architectural core, but the current npm default remains a semantic prerelease; pin the exact package version.

    As of July 16, 2026, npm’s latest tag for @rpamis/comet points to 0.4.0-beta.4, published July 12. It is the current default install, but the beta identifier still makes it a semantic prerelease. The last version without a prerelease suffix is 0.3.9, published June 18.

    Choice What it means Best fit
    @rpamis/comet@0.3.9 Last non-beta release; mature Classic workflow built around the 0.3 architecture Teams prioritizing a fixed, non-prerelease baseline
    @rpamis/comet@0.4.0-beta.4 Current npm default; pure Node runtime plus the expanded Skill and eval platform Evaluation, new integrations and teams willing to absorb beta changes
    Unpinned @rpamis/comet Currently resolves to beta.4 because npm latest points there Only when your update policy intentionally follows the current channel

    The repository calls Classic Spec “the stable core for long-running tasks.” Read that as a product-architecture claim: the five-phase lifecycle is the established center of Comet. It does not turn the 0.4.0-beta.4 package into a generally available 0.4 release. Likewise, beta.4’s release notes call several top-level commands “Stable Classic commands”; that describes their supported interface inside the beta, not the maturity label of the entire package.

    Pin the version in team setup documentation and automation. Otherwise, the same installation command can resolve to a materially different runtime over time.

    What changed in the 0.4 beta line

    The most visible engineering change is a pure Node runtime. The 0.4 README says Comet no longer depends on Bash or WSL; the package declares Node.js 20 or newer. This is especially meaningful for Windows users and for cross-platform workflow bundles, because state and guard logic no longer depend on a shell environment that behaves differently across machines.

    The product surface also expanded:

    • Classic Spec remains the requirements-to-archive workflow.
    • /comet-any authors composed Skill Bundles with workflow nodes, schemas, guards and handoffs.
    • comet eval supplies local or LangSmith-connected evaluation evidence.
    • comet dashboard provides a read-only browser view of active changes and archive history.

    Beta.4 adds or hardens ambient resume, a registry of project-scope installations, direct comet state, comet guard, comet handoff and comet archive commands, custom build evidence, multi-change guards, archive confirmation and Codex Skill discovery. Those details come from the official 0.4.0-beta.4 release, not from the older WeChat walkthrough.

    Surface 1: Classic Spec with /comet

    Classic Spec is for a software change that should move through a controlled lifecycle. Its conceptual phases remain:

    1. Open — turn an idea into an OpenSpec change and obtain human agreement on scope.
    2. Design — record architectural decisions and resolve ambiguity before implementation.
    3. Build — create an execution plan, choose isolation and implement under review rules.
    4. Verify — collect test, task and design-conformance evidence.
    5. Archive — synchronize the accepted delta into the main specification and close the change.

    The important mechanism is not the command sequence. It is durable external state. Each managed change stores workflow facts in .comet.yaml: phase, mode, artifact references, verification outcome and archive status. /comet can inspect that state and recommend the next legal action after a terminal restart or context reset.

    Guards are equally important. A useful workflow must reject illegal transitions, not merely remind the agent what it should do. Comet’s Classic runtime checks prerequisites before phase advancement and can restrict source writes while a change is still in requirements or design. Beta.4 also requires final archive confirmation to be represented in machine-owned state, so calling an internal path cannot silently bypass the human decision.

    A practical Classic setup

    Requirements are Node.js 20+, npm or npx, and Git. Choose a version deliberately:

    # Last non-beta release
    npm install -g @rpamis/comet@0.3.9
    
    # Current beta evaluated in this guide
    npm install -g @rpamis/comet@0.4.0-beta.4
    

    Then initialize inside the target repository:

    cd your-project
    comet init
    comet doctor --json
    comet status --json
    

    Use /comet from the supported coding agent to start or resume a change. Do not begin with automatic transitions enabled on a high-risk repository. First learn which points request scope, isolation, review and archive decisions. After the team trusts its checks, automation can reduce ceremony without hiding governance.

    Surface 2: /comet-any for workflow authoring

    /comet-any addresses a different problem: turning Skills into a distributable workflow rather than implementing a product feature. The current Skill defines a workflow contract in terms of:

    • Workflow Nodes that own resumable responsibilities;
    • Skill Bindings and required Skill calls;
    • Output Schemas attached to specific nodes;
    • Guardrails that permit or block advancement;
    • Handoffs containing cross-node or subagent evidence;
    • a workflow-protocol.json source of truth.

    This is more rigorous than placing several Skill names in a prompt. A bound Skill does not automatically replace a workflow node, and a schema declared globally does not enforce anything until it is attached to a concrete node. The authoring flow requires a proposal and human confirmation before generation, then creates scripts, rules, hooks, references and an eval manifest.

    There are two broad modes. A comet-five-phase-overlay customizes parts of Classic Spec while preserving .comet.yaml semantics and protected control nodes. A workflow-kernel is for a genuinely different lifecycle with its own state model and guard design. If a team wants to replace fundamental control nodes such as open, execute, verify or archive, it should treat that as a new kernel rather than quietly weakening Classic’s guarantees.

    Use /comet-any when the deliverable is a reusable workflow package. Use /comet when the deliverable is a software change. Mixing those intents produces confusing state and weak acceptance criteria.

    Surface 3: comet eval as evidence

    Comet product map linking guarded development, reusable workflow composition, and skill evaluation
    Comet separates guarded software changes, reusable workflow bundles, and evaluation evidence into three connected surfaces.

    comet eval asks whether a Skill can be discovered, executed and scored on defined tasks. For a bundle generated by /comet-any, the recommended sequence is:

    comet eval ./generated-skill/comet/eval.yaml --collect
    comet eval ./generated-skill/comet/eval.yaml --html
    

    --collect is a low-cost preflight: it checks the manifest, task discovery and dependency paths without starting the expensive evaluation. --html performs the run and creates a browsable report. The official documentation distinguishes raw runs from the clean analysis set and attributes failures to harness, workflow, task, model or environment instead of folding every infrastructure error into a Skill-quality score.

    For an early local Skill without an eval manifest, comet eval ./my-skill --quick --html is a smoke test. It is not final release evidence. Publish readiness expects evaluation tied to the current draft hash; failed, missing or stale-hash evidence blocks progression.

    The README discusses Rubric, Pass@k and Pass^k scoring and shows repository-generated benchmark charts. Treat those results as project evidence for its published tasks and treatments, not proof that every team’s custom workflow will improve by the same amount. Your tasks, model, environment and validators determine whether the measurement transfers.

    Choosing the right Comet path

    Start with the outcome:

    • For a feature, bug fix or refactor that needs traceable requirements and verification, use Classic /comet.
    • For a repeatable organizational process assembled from multiple Skills, use /comet-any.
    • For evidence that a Skill works across runs, use comet eval.
    • For a conservative rollout, pin 0.3.9 and test the beta in a separate repository.
    • For 0.4 capabilities, pin beta.4, record the version in artifacts and rerun evaluation when upgrading.

    Comet’s most valuable idea is not that an agent can execute five commands. It is that workflow control can be represented as files, state transitions, deterministic checks and review evidence. That architecture survives a context window. The 0.4 beta extends the same principle from one software-development workflow to a broader platform for composing and evaluating Skills.

    Sources

  • How to Prototype an AI-Assisted 3D Fight Scene with Blender MCP, Fable 5 and Three.js

    How to Prototype an AI-Assisted 3D Fight Scene with Blender MCP, Fable 5 and Three.js

    AI can now shorten the distance between a mood board and a playable-looking 3D scene. It does not remove the hard parts; it changes where they appear. Instead of spending all your time creating every texture, mesh and keyframe by hand, you spend more time checking topology, retargeting motion, controlling draw calls and deciding which generated assets are safe to ship.

    A July 2026 WeChat article by AI for Frontend offers a compact example: generate spell graphics, create a character mesh, extract motion from video, assemble the scene with Blender MCP and Claude, then present it in a Three.js browser experience. The source says a usable demonstration was produced in a day. That is a useful prototype claim, not a production benchmark—the article does not publish its prompts, project files, hardware profile or frame-time measurements.

    The more durable lesson is the shape of the pipeline. Each tool should own a narrow, inspectable artifact, and every handoff should have an acceptance test.

    The pipeline at a glance

    Stage Candidate tool Artifact to keep Acceptance test
    Visual direction GPT Image 2 reference images and transparent effect sheets consistent silhouette, palette and alpha edges
    Geometry and materials TRELLIS.2, Rodin, Blender cleaned mesh, UVs and PBR textures usable topology, scale, normals and material channels
    Agentic editing Blender MCP with Fable 5 or another Claude model Blender scene plus an operation log every change is visible, reversible and saved
    Character motion Mixamo or Video2MotionCapture skeleton, source motion and retargeted clip stable feet, joint limits and correct root motion
    Browser runtime Three.js GLB/GLTF assets, code and compressed textures target-device frame time, memory and loading budget

    That artifact-first framing matters. A model can appear to “build the game,” but the actual system is a chain of lossy transformations. Diagnose the artifact at the boundary, not the model’s explanation of what it thinks it did.

    1. Build a visual grammar before building a character

    OpenAI describes GPT Image 2 as an image generation and editing model that accepts text and image input. In this workflow, its best role is not “make all the art.” It is to establish a controlled visual grammar: a limited palette, repeated motifs, front/side references and effect textures designed for compositing.

    A transparent sheet containing sixteen violet glowing spell icons

    The source’s first generated sheet contains sixteen purple ability emblems on transparency. For a real game, separate the cells, trim transparent margins and pack them into an atlas.

    A pink and violet circular magic sigil on a transparent background

    A single high-contrast magic-circle texture can drive a decal, emissive plane or particle system. Keep the source image, the processed texture and its color-space setting together.

    A blue and orange circular magic sigil with transparent areas

    A second colorway can communicate a different ability state without requiring new geometry.

    Transparent images still need cleanup. Inspect premultiplied alpha, edge halos and empty pixels. For the browser build, resize to the maximum on-screen size, use texture atlases where appropriate, and test GPU-friendly compression. A beautiful 1024-pixel effect that occupies 120 pixels on screen is wasted bandwidth and memory.

    2. Let Blender MCP operate the scene, but keep Blender authoritative

    Blender MCP connects an MCP client to a Blender add-on. Its documented capabilities include inspecting a scene, manipulating objects and materials, executing Blender Python, retrieving external assets and making a Three.js sketch. This makes it a useful control plane, not a replacement for the .blend file.

    Claude Fable 5 is a plausible model for the long tool-using portion of this job. Anthropic says Fable 5 is available in Claude Code, while the source says Claude Sonnet 5 handled later code fixes. The model label is less important than operational discipline:

    1. Save a version before each structural operation.
    2. Ask for one observable change at a time.
    3. Require a viewport render or object summary after the change.
    4. Keep generated Blender Python in version control when possible.
    5. Never assume an agent’s “done” message proves scene correctness.

    Blender showing a glowing magic circle while an English agent transcript appears over the viewport

    The Japanese-localized Blender screenshot shows a magic-circle effect being reviewed after agent-driven changes. The useful pattern is the visual verification loop, not the specific prompt.

    Blender MCP can execute arbitrary Python inside Blender. That power deserves the same caution as any local automation: review unfamiliar scripts, restrict credentials, use trusted asset sources and keep backups. Fast iteration is valuable only when rollback is cheap.

    3. Treat image-to-3D output as a draft asset

    The source uses a ComfyUI wrapper around TRELLIS.2 for base geometry. The TRELLIS.2 project describes a 4-billion-parameter image-to-3D model capable of PBR attributes such as base color, roughness, metallic and opacity. Its headline timing figures were measured on an NVIDIA H100, so they should not be read as consumer-hardware expectations.

    A blue-armored fantasy character beside a gray mesh and a reference render

    The source compares an in-scene armored character with mesh and rendered references. Visual similarity does not establish animation-ready topology.

    Before rigging, inspect the mesh for disconnected parts, self-intersections, thin surfaces, non-manifold areas, inconsistent normals and an impractical polygon count. Then normalize scale and orientation, decide which materials genuinely need separate draw calls, and rebuild UVs if the generated layout is inefficient. A static render can hide problems that become obvious as soon as elbows bend or a cape moves.

    Rodin is another possible asset source, and Blender MCP documents direct Hyper3D Rodin integration. Whichever generator you use, retain its license terms and provenance beside the asset. “Generated” does not automatically mean unrestricted, and motion or body-model dependencies may impose separate conditions.

    4. Motion is a retargeting problem, not a file-import problem

    For standard humanoids, Mixamo remains a convenient baseline. Adobe’s Mixamo FAQ says its auto-rigger and animation library support bipedal humanoids only, and it lists failure cases such as extra limbs, wings, large props, disconnected parts and non-neutral poses. Ornate armor and oversized cloth can therefore break an otherwise simple upload.

    The source’s more experimental route uses ComfyUI-Video2MotionCapture. Its repository labels the project “WIP” and describes a pipeline from video to SMPL motion, rigged FBX export and retargeting to Mixamo-compatible or custom characters. It also calls for roughly 3.5 GB of model downloads and notes separate licensing for underlying SMPL and GVHMR assets.

    A dance video, extracted body motion and retargeted armored character shown side by side

    The motion-capture workflow maps a human performance to a 3D body and then to the armored character. The screenshot demonstrates the concept, not retargeting quality.

    A poster frame from the embedded motion-capture video showing the dancer and two 3D characters

    This preserved poster frame came from the source’s embedded video. It shows a different pose in the same capture-to-retarget sequence.

    Review retargeted clips at half speed. Look for foot sliding, knee inversion, shoulder collapse, hand intersections, scale mismatch and root-motion drift. Fight animation also needs gameplay edits: anticipation, contact, recovery, cancel windows and hit timing. A captured dance can provide movement vocabulary, but it does not automatically become a readable attack.

    5. Optimize the handoff to Three.js

    Export a GLB/GLTF test asset early, before the Blender scene becomes elaborate. The official Three.js GLTFLoader documentation is the stable reference for loading these assets. Keep a small automated scene that loads every current export and reports missing textures, animation names and bounding dimensions.

    The browser build needs budgets that the source article does not provide. At minimum, measure:

    • compressed download size and first-interaction time;
    • triangles, materials, draw calls and texture memory;
    • CPU animation cost and GPU frame time on the weakest target device;
    • the cost of transparent particles and overlapping emissive effects;
    • fallback behavior when WebGL capability or memory is limited.

    The source links a live effect-verification demo, which was reachable during review. Its existence shows the pipeline can produce a browser artifact; it does not by itself prove maintainability, asset rights or stable performance across devices.

    An English-localized browser fight-scene prototype with a character casting a spell above a glowing circle

    The source’s final embedded-video poster shows the prototype’s combat HUD and spell effect. Japanese text at the bottom reports the character using a thunderbolt ability.

    What a one-day prototype can—and cannot—prove

    A day is enough to answer a narrow question: can these assets, this motion and this effect language coexist in a browser scene? It is not enough to establish a production pipeline. The next milestone should be a vertical slice with one character, one enemy, one attack and one target device, all passing explicit budgets.

    That slice should preserve provenance, reproduce exports from saved inputs, survive a clean checkout, and hold frame time under stress. If it does, the AI-assisted workflow has become more than a demo. It has become an engineering system that can be improved.

    Sources

  • Claude Dynamic Workflows on Codex: What This Community Project Actually Does

    Claude Dynamic Workflows on Codex: What This Community Project Actually Does

    The open-source project claude-dynamic-workflows-codex connects two systems that are usually discussed separately: Claude Code writes a JavaScript orchestration workflow, while local Codex agents execute the work through Codex app-server. That distinction matters. This is not a native Codex /dynamic command, and it is not an official OpenAI or Anthropic integration. It is a community-built Claude Code plugin and standalone runner that uses Codex as its agent backend.

    A Chinese WeChat article from Ai 这个时代 introduced the project as a way to reduce context pressure in multi-agent work. The underlying idea is sound, but the current repository differs from several operational details in that account. The repository’s documented command is /codex-workflows, installation happens from Claude Code’s plugin marketplace or a Claude skills directory, and the project explicitly describes itself as unofficial.

    The architecture: orchestration in code, execution in Codex

    Architecture diagram showing a Claude-inspired workflow definition orchestrating Codex execution and reusable state
    The community plugin routes a generated workflow through Codex app-server and stores reusable workflow state; it is not a Codex-native skill.

    Dynamic workflows move coordination logic out of the conversational loop and into a JavaScript program. The script can express parallel phases, pipelines, budgets, races, review gates, and stopping conditions. Intermediate results can remain in runtime variables rather than being pasted wholesale into the top-level conversation.

    In this project, Claude Code turns a rough request into that workflow script. The runner then connects to the local codex app-server, starts Codex threads, streams events, records progress in a journal, and renders the run as either a terminal map or an interactive browser view. OpenAI’s documentation describes app-server as the interface for deep client integrations that need authentication, conversation history, approvals, and streamed agent events. The community project is therefore building on a real, documented Codex integration surface rather than scraping a terminal UI.

    The practical result is a separation of responsibilities:

    • Claude Code acts as the workflow author and operator.
    • JavaScript holds the execution graph, branching, and intermediate state.
    • Codex app-server supplies the agent threads and streamed execution events.
    • A journal supports replay, inspection, and resuming unfinished work.
    • The viewer exposes phases, workers, token counts, timing, and final results.

    This is more than a cosmetic wrapper around subagents. The repository adds sessionful workers that can receive follow-up instructions on an existing thread, races that cancel losing approaches, human gates, run summaries, and a multi-workflow fleet mode. Those features are implemented by this repository; they should not be mistaken for guarantees attached to every Codex client.

    What problem does it solve?

    Standard subagent delegation is useful when several bounded tasks can run independently. Current Codex documentation says subagents can keep noisy exploration and test output away from the main thread, but it also warns that every worker performs its own model and tool work, so multi-agent runs generally consume more tokens than comparable single-agent work.

    A scripted workflow becomes attractive when the coordination pattern itself needs to be durable. Examples include:

    • scanning many independent areas and then adversarially verifying the findings;
    • racing several root-cause hypotheses and stopping the losing workers;
    • loading a large corpus once and asking repeated questions on the same warm thread;
    • pausing at a human decision before a risky phase;
    • resuming a long run without repeating every completed step;
    • comparing structured run journals over time.

    The benefit is not simply “more agents.” It is the ability to make fan-out, review, cancellation, and convergence explicit and repeatable. For a one-off question or a small edit, that machinery is unnecessary overhead.

    The token claim needs a narrower reading

    Evidence boundary for the repository's warm-versus-cold workflow benchmark
    The repository benchmark is directional evidence for one repeated-context workload, not proof of universal savings or production reliability.

    The source article says the port uses fewer tokens than Claude Code’s native dynamic workflow. The repository does publish evidence, but it supports a more limited conclusion.

    Its warm-versus-cold benchmark used Codex 0.137.0, GPT-5.5 at medium effort, a roughly 3,300-line corpus, and three follow-up questions. A warm worker spent 329,000 tokens on initial ingestion and about 69,000 tokens per follow-up. Fresh workers that reread the corpus used about 219,000 tokens per question. Across all three questions, the warm arm reported 535,000 tokens versus 656,000 for the cold arm, with substantially lower marginal latency.

    That is useful evidence for repeated interrogation of the same material. It is not a general comparison between this project and every native Claude Code workflow. The repository itself notes that the warm approach loses for a single question because the initial ingestion dominates. Results will also vary with corpus size, model, cache behavior, effort, prompt design, and the workflow graph. Anyone making cost decisions should rerun the included benchmark on their own workload and compare total billed cost, not token count alone.

    Accurate setup and a low-risk first test

    The repository currently requires Node.js 18 or newer and a logged-in codex CLI on the local path. Its recommended Claude Code installation is:

    /plugin marketplace add scasella/claude-dynamic-workflows-codex
    /plugin install codex-workflows@codex-workflows

    After installation, a task is invoked from Claude Code with a command such as:

    /codex-workflows Audit every route under src/ for missing authorization, read-only

    Before spending model tokens, the repository also includes an offline viewer demo:

    git clone https://github.com/scasella/claude-dynamic-workflows-codex
    cd claude-dynamic-workflows-codex
    node runner/bin/view-run.js examples/incident-demo --open

    That demo is the safest way to inspect the execution map without launching agents. For a live first run, use a small read-only task, inspect the generated workflow script, set a hard budget, and confirm that the Codex version and permissions match the repository’s expectations.

    Where it fits—and where it does not

    This project is a credible option for developers who already use Claude Code as their control surface but want Codex agents underneath a repeatable orchestration layer. It is especially interesting for research, large audits, migrations, incident analysis, and workloads where the same warm context will answer several questions.

    It is a weaker fit when:

    • one capable agent can finish the task directly;
    • the work is dominated by a single sequential dependency;
    • concurrent edits would create merge conflicts;
    • the organization cannot accept a community integration spanning two vendors’ tools;
    • reproducibility, audit, and version pinning have not been established;
    • a CI job would be better served by OpenAI’s supported SDK or GitHub Action.

    There are also operational costs. More agents can mean more token usage, more local processes, more permission decisions, and a larger failure surface. The generated script is executable orchestration and deserves review. Sandboxing should reflect the task, secrets should stay out of prompts and journals, and model or protocol changes can break an unofficial integration even when both underlying products continue to work independently.

    Bottom line

    claude-dynamic-workflows-codex is best understood as an experimental orchestration bridge: Claude Code authors the plan, a JavaScript runtime manages it, and Codex app-server executes agent threads. Its strongest contribution is not a universal promise of cheaper agents. It is a concrete, inspectable way to encode multi-agent control flow, preserve run state, and reuse warm workers.

    That can materially improve the economics of the right repeated-context workload. It does not remove the need to size the workflow, review permissions, validate outputs, and measure the actual bill. Start with the offline demo, then a small read-only run, and promote the pattern only after its journal shows that the extra orchestration is buying something a simpler approach cannot.

    Sources

  • Who Gets to Decide? Designing an Authority Control Plane for AI Coding Agents

    Who Gets to Decide? Designing an Authority Control Plane for AI Coding Agents

    Imagine asking a coding agent to “make failed payments more reliable.” It finds the background-job system, adds three automatic retries, writes passing tests, and produces a clean pull request. The implementation is technically competent. It may also violate customer-support policy, create duplicate-payment risk, and change the product experience without anyone authorising those choices.

    This is not primarily a hallucination problem. The agent may understand the code perfectly. The failure is authority leakage: a system designed to execute work silently becomes the owner of a decision that belongs to a product, security, legal, or operations role.

    A recent update to Matt Pocock’s open-source grilling workflow, reached through the small grill-me wrapper, makes two useful ideas explicit. The agent should investigate facts that already exist, and it should wait when the answer depends on a human choice. A confirmation gate then checks shared understanding before execution.

    Those rules are a good starting point. Production agent systems need a broader operating model: one that connects conversational confirmation to tool permissions, sandbox boundaries, network policy, audit records, rollback, and measurable reliability. In other words, an agent needs an authority control plane, not just a polite prompt.

    Authority is different from capability

    Models are increasingly capable of proposing product rules, migration strategies, security controls, and operational responses. Capability answers, “Can the system produce a plausible solution?” Authority answers, “Who is entitled to choose this outcome, and under which constraints?”

    The distinction matters because a repository contains several different kinds of information:

    Information class Typical source Correct agent response
    Retrievable fact Code, tests, configuration, logs, documentation, authorised tools Investigate and cite the evidence
    Non-negotiable constraint Regulation, contract, compatibility guarantee, budget, explicit project rule Preserve it and flag conflicts
    Owned preference Product intent, risk tolerance, policy, design direction, new trade-off Present options and wait for the responsible owner
    Testable hypothesis Prediction about users, performance, adoption, or an uncertain technical approach Design a prototype, measurement, or reversible experiment

    The fourth category prevents a subtle mistake. If no internal caller uses an API, that does not prove an external customer is not using it. Repository search cannot settle the question, but neither can a manager’s preference. The answer may require telemetry, a deprecation window, or a controlled experiment.

    This expanded classification produces a better division of labour:

    • Agents retrieve evidence.
    • Systems enforce constraints.
    • Accountable people make choices.
    • Experiments resolve hypotheses.

    NIST’s AI Risk Management Framework supports this organisational view. Its core asks organisations to define human and AI roles, document system knowledge limits, specify how outputs are overseen, and assign responsibility for AI risk. Oversight is therefore a designed operating process, not a generic “human in the loop” label.

    Replace binary approval with four action modes

    Not every tool call deserves the same interruption. A useful control plane assigns each proposed action to one of four modes.

    1. Observe

    Read-only inspection of code, documentation, logs, schemas, or authorised dashboards. These actions should usually proceed automatically when access is already in scope. The agent records what it inspected and does not mutate state.

    2. Prepare

    The agent creates a draft, diff, plan, migration preview, query, or message without applying it to the live target. Preparation is valuable because it converts an abstract request into something a reviewer can inspect. A prepared database migration is not the same as running it; a drafted email is not the same as sending it.

    3. Execute with guardrails

    The agent performs a bounded, reversible mutation inside a defined environment. Examples include editing files in a worktree, running tests in a sandbox, or changing a feature flag for a small canary. The control plane limits tools, credentials, network destinations, scope, and runtime.

    4. Explicit approval

    The action affects an external system, uses privileged credentials, creates a material commitment, changes customer-visible policy, destroys data, or is difficult to reverse. The agent pauses and presents an approval packet tied to the exact action.

    This model is stricter than “ask before every write” and more useful than “let the agent decide.” It allows low-risk work to move quickly while concentrating attention on authority transitions.

    English grill-me update banner reading “The missing piece is finally in place” and “Major update,” beside a glowing puzzle piece and illustrated character.

    English redraw of an illustration from the original Chinese report. The translated headline announces a major grill-me workflow update.

    Use an authority budget, not a vague risk label

    “High risk” is too imprecise to drive tooling. A more actionable approach evaluates five dimensions:

    1. Impact: what happens if the action is wrong?
    2. Irreversibility: can the previous state be restored completely and quickly?
    3. Scope: how many users, records, services, or repositories are affected?
    4. Uncertainty: how strong is the evidence that the proposed action is correct?
    5. Novelty: is this a familiar, tested pattern or a new path with weak operational history?

    This is an editorial synthesis of NIST risk management, OWASP least-agency guidance, and release-engineering practice—not a published standard. Its value is operational: increasing any dimension should reduce the agent’s autonomy or increase the strength of the control.

    The same idea can be expressed as an authority budget:

    • Which tools may the agent invoke?
    • Which data and resources may those tools reach?
    • How large a side effect may one action create?
    • How long may the agent continue before a checkpoint?

    A local formatting change may have a generous budget. A production schema deletion should have almost none.

    OWASP’s guidance on excessive agency identifies excessive functionality, permissions, and autonomy as distinct root causes. That separation is important. Even a well-instructed model remains dangerous if its tool can execute arbitrary shell commands with a production administrator credential. Conversely, a narrowly scoped tool operating under the current user’s identity can make a model error much less damaging.

    A confirmation packet should be parameter-bound

    The least useful approval prompt is “Continue?” It hides the information the reviewer needs and encourages reflexive acceptance.

    A serious approval packet should contain:

    • Outcome: the user-visible or operational result.
    • Exact action: tool, target, parameters, command, request, or proposed diff.
    • Affected resources: files, services, records, users, and external systems.
    • Effective identity: whose credential and which scopes will be used.
    • Evidence: tests, repository facts, policies, and primary documentation.
    • Decisions: choices already made and their accountable owner.
    • Residual uncertainty: assumptions and unverified inferences.
    • Blast radius: plausible worst-case impact.
    • Recovery: rollback, restore, cancellation, or containment path.
    • Reason for escalation: the boundary that requires approval.

    The OpenAI Agents SDK human-approval flow illustrates several implementation details. Approval can be attached to specific tools, execution can pause with the tool name and arguments visible, state can be serialised, and the original run can resume after approval or rejection. Decisions can be scoped to one call instead of becoming vague permission for everything that follows.

    That last point is critical. “Yes, send this email” should not become “Yes, send any future email.” Sticky approval can be convenient within a bounded run, but it should be explicit, time-limited, and tied to a known tool and scope.

    Separate the decision plane from the execution plane

    The same model that proposes an action should not be the only mechanism deciding whether the action is permitted. Prompts express policy intent; enforcement belongs in the surrounding system.

    A bounded-autonomy architecture uses at least six control surfaces:

    Tool surface

    Expose only necessary operations. Prefer read_invoice and schedule_retry over a general shell or unrestricted HTTP client. Validate structured arguments before execution.

    Identity surface

    Run actions in the requesting user’s context where possible. Use short-lived credentials, narrow OAuth scopes, least-privilege database roles, and separate read from write identities.

    Filesystem and process surface

    Place code execution in an isolated workspace. Anthropic’s Claude Code sandboxing report describes filesystem and network isolation as complementary boundaries and reports that sandboxing reduced internal permission prompts by 84%. A filesystem boundary alone does not stop exfiltration; a network boundary alone does not stop local secret access.

    Network surface

    Default-deny outbound access for sensitive workflows, then allowlist required destinations. Log allowed and denied requests. Do not treat a URL fetched from untrusted content as implicitly authorised.

    Approval surface

    Pause before boundary-crossing actions and show the parameter-bound packet. Keep the approval mechanism outside the agent’s natural-language reasoning loop.

    Trace surface

    Record model and policy version, user goal, selected tool, exact arguments or diff, target, effective identity and scope, approval identity and time, result, and rollback pointer. NIST SP 800-53 provides implementation-grade least-privilege and audit principles: processes should receive only the privileges required, privileged functions should be audited, and audit records should capture who did what, where, when, and with what result.

    OpenAI’s description of running Codex safely follows the same layered logic: sandbox policy constrains writes and network access, approvals govern boundary crossings, and telemetry captures security-relevant activity. The design lesson is more important than any vendor implementation: safety emerges from layers that fail independently.

    Approval fatigue is a safety defect

    Requiring confirmation for every action sounds conservative. In practice it can train reviewers to click through.

    A controlled USENIX SOUPS study on warning habituation found that repeated non-security notifications reduced attention and adherence even for a new security warning, especially when the interfaces looked similar. The study was not about coding agents, so applying it here is an informed analogy. The implication is still useful: uniform approval dialogs can make exceptional risk look routine.

    Approval design should therefore be tiered:

    • Do not interrupt for authorised read-only investigation.
    • Batch related low-risk prepared changes into one reviewable diff.
    • Use distinct visual treatment for privileged, destructive, or externally visible actions.
    • Explain why the action escalated.
    • Show the exact side effect, not only the agent’s rationale.
    • Measure approval volume, rejection rate, and time-to-decision.
    • Remove approval prompts that never affect the outcome.

    The goal is not zero friction. It is high-information friction at the moment responsibility changes hands.

    Checkpoint, validate, and promote

    Conversation-level approval is only one checkpoint. A stronger workflow separates preparation from promotion:

    1. Snapshot: create a commit, worktree, database snapshot, or versioned configuration before mutation.
    2. Act in isolation: let the agent modify a sandbox or staging target.
    3. Validate: run deterministic tests, static analysis, policy checks, security scans, and task-specific graders.
    4. Review evidence: present the diff, results, residual risk, and rollback pointer.
    5. Promote atomically: merge, deploy, publish, or switch traffic only after the required approval.
    6. Observe: monitor defined success and failure signals.
    7. Rollback or expand: restore the previous state when thresholds fail, or progressively increase scope when evidence remains healthy.

    This pattern imports proven release-engineering ideas into agent workflows. Google SRE’s canarying guidance recommends small, self-contained changes because they are easier and cheaper to reverse. A canary exposes only a limited population while the system compares outcomes and decides whether to continue.

    For coding agents, the equivalent may be a local worktree, draft pull request, shadow query, dry run, feature flag, or limited rollout. Autonomy can increase as reversibility increases.

    Worked example: redesigning payment retries

    Return to the failed-payment request.

    Observe

    The agent inspects the queue, payment-provider integration, idempotency-key handling, error taxonomy, customer notifications, dashboards, and existing tests. It records factual findings and links them to files or documentation.

    Map constraints

    The agent identifies provider limits, contractual commitments, compliance requirements, and existing support procedures. If those sources conflict, it flags the conflict instead of selecting the most convenient interpretation.

    Isolate owned choices

    The team must decide which errors qualify for retry, maximum delay, customer-visible state, notification timing, and ownership of a final failure. The agent presents options and consequences.

    Identify hypotheses

    Whether retries improve recovery without increasing duplicates is an empirical question. The plan may require a small canary, a shadow calculation, or historical replay before changing live behaviour.

    Produce the approval packet

    The packet might propose one retry for a narrow transient-error class, preserve the existing idempotency key, exclude declined cards, add an operator metric, limit rollout to 5%, and automatically disable the flag when duplicate-attempt or error thresholds are exceeded.

    Execute and observe

    The agent implements the bounded change in a worktree, runs tests, opens a reviewable diff, and waits before production promotion. After approval, the system deploys gradually and records overrides, failures, and rollback decisions.

    Most work remains agent-owned. Human attention is reserved for customer policy, financial risk, and production authority.

    Evaluate both outcomes and trajectories

    An agent saying “done” is not evidence. The final environment state must prove the claim.

    Anthropic’s guide to agent evaluations distinguishes the outcome from the trajectory. The outcome is what changed in the environment; the trajectory is the sequence of model turns, tool calls, and intermediate actions. Both matter:

    • A correct patch produced through an unauthorised production action is not a safe success.
    • A perfectly compliant trajectory that fails to solve the task is not a useful success.

    Use deterministic graders where possible: tests, schema validation, file assertions, permission checks, and state comparison. Use model-based grading for qualities that resist exact rules, then calibrate those graders periodically against human experts.

    Evaluation should also separate:

    • Capability suites: difficult tasks that reveal what the agent may be able to do.
    • Regression suites: established behaviours expected to pass consistently.
    • First-try usefulness: often expressed as pass@1.
    • Consistency: the probability of succeeding across repeated trials, often expressed as pass^k.

    Benchmarks such as SWE-bench are valuable because they apply generated patches to real repositories and run tests in controlled environments. They do not replace organisation-specific evaluation. Production authority failures may never appear in a repository issue benchmark.

    Infrastructure can distort results too. Anthropic reported in its analysis of evaluation infrastructure noise that resource configuration alone moved Terminal-Bench 2.0 scores by six percentage points in one study. Small leaderboard differences should not drive autonomy policy unless the environments are comparable.

    For long-running work, task duration matters. METR’s task-completion time horizon asks how long a task would take a human expert at a specified agent success probability. An operational inference follows: as the expected task horizon grows, checkpoints, state persistence, evidence review, and recovery mechanisms should become stronger.

    Metrics for the authority control plane

    Track technical performance and oversight quality together:

    • Task success rate after environment verification.
    • First-try success and repeated-trial consistency.
    • Approval requests per completed task.
    • Approval acceptance, rejection, and override rates.
    • False-positive escalations: the agent asked for a decision that evidence could answer.
    • False-negative escalations: the agent acted where approval was required.
    • Time to escalation and time waiting for a decision.
    • Post-approval failure rate.
    • Rollback frequency and mean time to recovery.
    • Tool errors, retry loops, and policy violations.
    • Blast radius of failed actions.
    • Human overrides by action class.
    • Cost and token use per verified outcome.

    The target is not fewer approvals at any cost. It is better allocation: fewer interruptions for facts, more reliable escalation for real authority changes, and stronger evidence before irreversible actions.

    Confirmation belongs inside a lifecycle

    NIST’s Generative AI Profile places governance, testing, monitoring, incident response, recovery, and deactivation in one lifecycle. Relevant practices include sending pre-deployment test evidence to release authorities, recording human overrides, defining escalation routes, maintaining fallback procedures, and establishing criteria for deactivation.

    That suggests a continuous control loop:

    Test → authorise → observe → override → learn → rollback or deactivate

    A confirmation gate handles the authorise step. It cannot compensate for missing monitoring, an unusable rollback path, or a system that never learns from rejected approvals.

    A practical rollout sequence

    Teams do not need to build the entire control plane at once.

    First: inventory side effects

    List every tool and classify whether it reads, prepares, mutates locally, affects an external system, uses privileged identity, or performs an irreversible action.

    Second: narrow the execution surface

    Remove unused tools, split broad functions, reduce credential scopes, and run code in isolated workspaces. Enforce limits outside the prompt.

    Third: define escalation policy

    Assign action modes, authority owners, and the evidence required for promotion. Make rules parameter-bound and test them on both positive and negative examples.

    Fourth: make recovery real

    Add snapshots, dry runs, feature flags, limited rollouts, cancellation, and rollback. Test recovery rather than documenting an unverified command.

    Fifth: trace and evaluate

    Record trajectories and final state. Seed an evaluation suite with actual failures, including cases where the agent should proceed and cases where it must stop.

    Sixth: tune the human experience

    Measure approval burden and remove low-value interruptions. Preserve prominent, information-rich prompts for high-impact actions.

    What this model cannot guarantee

    An authority control plane does not make an agent correct. A reviewer can approve a harmful action. A sandbox can be misconfigured. A tool can hide side effects. A rollback can fail after data has propagated. A model can produce a persuasive but false rationale.

    The design therefore assumes failure and limits its consequences. Prompts express intent; permissions bound capability. Tests provide evidence; traces support investigation. Human approval allocates responsibility; staged execution and rollback preserve operator control.

    The most mature agent is not the one given unlimited freedom. It is the one embedded in a system that knows the difference between evidence, experimentation, and authority—and can prove what happened after the decision.

    References

  • Superpowers vs. Grill Me: Match AI Planning to the Cost of Being Wrong

    Superpowers vs. Grill Me: Match AI Planning to the Cost of Being Wrong

    A substantially expanded English analysis of a Chinese article by 大刘 (AI大刘), updated with current project documentation, official coding-agent guidance, and empirical research on clarification and planning.

    AI coding is rarely limited by how fast a model can produce code. The expensive failure mode is building a plausible solution to the wrong problem, then discovering the mismatch after code, tests, and assumptions have accumulated. That is why planning skills have become popular. But “more planning” is not a universal answer, and “more questions” is not a quality metric.

    This article responds to 大刘’s original WeChat article, which contrasts the comprehensive Superpowers workflow with Matt Pocock’s compact Grill Me skill. Its central intuition is useful: the tools allocate decision-making differently. Current documentation and newer research sharpen that claim. The practical question is not “Which tool wins?” It is “Which uncertainty are we reducing, and how costly would a wrong answer be?”

    English banner introducing a practical comparison of Superpowers and Grill Me
    A practical comparison of Superpowers and Grill Me. English-localized derivative based on the original visual by 大刘 / AI大刘.

    Clarification, planning, and verification do different jobs

    Many discussions collapse three activities into “thinking before coding.” That hides their different purposes:

    • Clarification reduces uncertainty about what should be built. It resolves intent, constraints, ownership, acceptable trade-offs, and observable success.
    • Planning manages dependencies in how it will be built. It orders changes, identifies interfaces, assigns verification, and exposes coordination risks.
    • Verification produces evidence that the result is acceptable. Tests, logs, type checks, screenshots, diffs, and human review answer a different question from either clarification or planning.

    Claude Code’s official Plan mode illustrates the distinction. It is primarily a research-and-approval boundary: the agent can inspect the project and propose changes, but edits remain blocked until the plan is approved. That is valuable, yet it does not guarantee that the agent asked the product owner the one question that changes the feature’s meaning. A plan can be detailed and still encode the wrong requirement.

    The reverse is also true. A thorough interview can establish intent without producing a safe migration sequence, a test strategy, or a reviewable implementation contract. The three layers complement one another; substituting one for all three is the mistake.

    English graphic framing the friction of turning vague requirements into agent work
    Vague requirements create friction when an agent must turn them into work. English-localized derivative based on the original visual by 大刘 / AI大刘.

    The 2026 comparison is stack versus primitive

    The most important correction to a simple Superpowers-versus-Grill-Me framing is that these are not equivalent products at different sizes.

    As checked on 14 July 2026, grill-me itself is a tiny user-invoked wrapper: it starts the underlying grilling skill. The current instructions say to walk a decision tree one question at a time, recommend an answer with each question, investigate facts available in the environment, leave decisions to the user, and wait for shared understanding before acting.

    Matt Pocock’s broader repository now routes different situations to different skills. Its current ask-matt guidance directs greenfield, stateless discussion toward Grill Me; existing-codebase work that needs durable context toward grill-with-docs; and larger work through specification, ticketing, implementation, and review steps. Grill Me is therefore one entry point in a growing workflow stack, not a complete one-file replacement for design records, execution, testing, and review.

    Superpowers is explicitly a full software-development methodology. Its latest formal release at the time of checking was v6.1.1, published 2 July 2026. The repository contained 14 top-level skills, and its documented chain runs from brainstorming through worktree isolation, detailed planning, subagent or sequential execution, test-driven development, review, verification, and branch completion.

    English graphic contrasting two repositories with different scopes
    The two repositories operate at different levels of scope. English-localized derivative based on the original visual by 大刘 / AI大刘.

    This changes the comparison. The real alternatives are closer to these:

    Layer Matt Pocock workflow Superpowers workflow Primary output
    Intent discovery grill-me, grilling, or grill-with-docs brainstorming Agreed decisions and constraints
    Durable design Context and decision records, then spec when needed Written design spec with review gates Reviewable design artifact
    Decomposition Spec and tickets for larger work writing-plans with small verified tasks Ordered implementation contract
    Execution implement and related engineering skills Subagent-driven or plan execution Code changes in bounded steps
    Quality control TDD and final review in the broader stack TDD, task review, branch review, completion verification Evidence, review findings, release choice

    The fair conclusion is not that Grill Me replaces Superpowers. It is that a compact clarification primitive can be useful before, inside, or instead of a larger methodology depending on the task’s risk and coordination needs.

    Superpowers has also become more deliberate about user decisions

    The current Superpowers brainstorming instructions do not simply let the agent decide everything. They tell the agent to inspect the project first, ask questions one at a time, propose two or three approaches with trade-offs, present the design in sections, obtain approval, write a design document, self-review it, and obtain review of the written specification before moving to planning.

    That overlap matters. Both approaches separate facts the agent can discover from decisions the owner must make. Their main difference is what happens around and after the interview. Superpowers persists design artifacts and connects them to a mandatory engineering chain. Grilling can stop at shared understanding or hand off to other skills selected for the job.

    English graphic presenting Superpowers as an end-to-end workflow
    Superpowers is an end-to-end development methodology. English-localized derivative based on the original visual by 大刘 / AI大刘.
    English screenshot illustrating the mandatory instruction style discussed in the source
    The source article discusses mandatory workflow instructions. This describes a workflow style, not a guarantee that every model and installation will comply identically. English-localized derivative based on the original visual by 大刘 / AI大刘.

    Superpowers’ current writing-plans skill also reaches beyond a prose outline. It asks for exact files, interfaces, concrete code or commands, small actions, test-first RED/GREEN steps, and commits. That is expensive compared with a three-bullet plan, but it creates a portable execution artifact. The cost is justified when another agent or engineer must resume the work, when multiple components change in dependency order, or when reviewers need to detect divergence before merge.

    English graphic illustrating a longer planning document
    A longer planning artifact can make assumptions and dependencies reviewable, but it also creates reading and approval work. English-localized derivative based on the original visual by 大刘 / AI大刘.

    The project is not static. Superpowers’ v6.0.0 release consolidated review steps, added branch-level review and plan checks, and revised interfaces and global constraints. Its v6.1 line reduced bootstrap overhead and improved Codex integration. It is therefore misleading to treat “Superpowers overhead” as a fixed property measured by one older run. Workflow cost depends on release, harness, model, codebase, and configuration.

    Grill Me protects decision ownership—but should not ask everything

    Grilling’s most useful rule is not “ask many questions.” It is “research facts; ask the user for decisions.” A repository can usually answer which framework is installed, how neighboring endpoints authorize requests, which commands run tests, and whether a migration helper already exists. Asking a user for those facts wastes attention and invites stale answers.

    The user is needed for questions that the environment cannot settle: whether backward compatibility matters more than cleanup, which failure mode is acceptable, whether a data migration may be irreversible, who can view a new field, or what business event counts as success.

    English graphic introducing Grill Me as an interview-style skill
    Grill Me is an interview-style skill and one entry point in a broader workflow. English-localized derivative based on the original visual by 大刘 / AI大刘.
    English graphic summarizing Grill Me’s one-question-at-a-time workflow
    The approach asks one question at a time, recommends an answer, checks the environment for discoverable facts, and waits for agreement. English-localized derivative based on the original visual by 大刘 / AI大刘.

    That division makes human attention a scarce engineering resource. Approval prompts can become theater when they appear at every minor action. The better control points are boundaries with real consequence: freezing the requirement, accepting the plan, crossing a sandbox or network boundary, applying an irreversible migration, merging, or publishing. Low-risk, local, reversible steps can proceed inside an agreed boundary and return evidence afterward.

    English graphic illustrating shared understanding before implementation
    The desired outcome is shared understanding before implementation begins. English-localized derivative based on the original visual by 大刘 / AI大刘.

    Research supports targeted clarification, not maximum interrogation

    The empirical literature gives stronger support to clarification than the original single-run comparison, but it also warns against overgeneralization.

    The 2024 FSE paper ClarifyGPT detected ambiguous requirements, generated targeted questions, refined the request from the answers, and then generated code. In its small human study, GPT-4 Pass@1 on MBPP-sanitized rose from 70.96% to 80.80%. Across four automated benchmark evaluations, average GPT-4 performance rose from 68.02% to 75.75%, while ChatGPT rose from 58.55% to 67.22%. Those are meaningful results, but the human study had ten participants, the tasks were mainly function-level Python problems, and the larger evaluation relied on simulated user feedback. It supports the mechanism—not a claim that every large repository needs a long interview.

    A newer 2026 study, Ask or Assume?, tested clarification on underspecified variants of SWE-bench Verified. Its uncertainty-aware multi-agent setup resolved 69.4% of tasks versus 61.2% for a standard single-agent setup. The agent also conserved questions on easier tasks. Again, the missing information and user interaction were experimentally constructed, so the result is evidence for uncertainty-aware clarification rather than a production guarantee.

    Most directly relevant to Grill Me’s “37 questions” story, Asking What Matters found that increasing question count did not consistently improve task success; performance plateaued while the share of answerable questions declined. Its trained clarification module matched GPT-5’s resolution rate on the study’s underspecified issues with 41% fewer questions. The authors identify two useful criteria: task relevance—does the missing information predict success?—and user answerability—can the user realistically supply it?

    That yields a better question test:

    1. Can the agent find the answer in code, documentation, logs, tests, or a small experiment? If yes, investigate instead of asking.
    2. Could different answers materially change the interface, data model, permission boundary, compatibility promise, or acceptance criteria? If no, defer or choose a reversible default.
    3. Is the person being asked actually able and authorized to decide? If no, identify the owner or state the unresolved risk.
    4. Will the answer be converted into a constraint or observable check? If no, the question may create conversation without reducing implementation risk.

    The important unit is information gain per interruption, not questions per session.

    Planning evidence is strongest when dependencies matter

    Clarification is not the only intervention with empirical support. The 2024 TOSEM paper Self-Planning Code Generation reported relative Pass@1 improvements of up to 25.4% over direct generation by having models generate concise implementation steps first. The tasks were primarily algorithmic and function-level, so the exact gain should not be projected onto production repositories.

    Repository-scale evidence is more relevant to Superpowers’ value proposition. Microsoft Research’s CodePlan used dependency-aware multi-step planning on repository migrations and temporal edits touching between 2 and 97 files. It passed build and correctness checks in five of seven repositories; a context-matched baseline without planning passed none. The sample was small and the task types were structured, but the result captures where planning earns its keep: later edits depend on earlier ones, and local correctness does not imply repository-level correctness.

    Conversely, bounded work with a strong evaluator can benefit from a simpler loop. Agentless used a fixed localization–repair–validation pipeline rather than a highly autonomous workflow and solved 96 of 300 SWE-bench Lite issues in its reported evaluation. That historical benchmark does not settle today’s tool choice, but it illustrates a durable point: when the scope is narrow and the verifier is reliable, disciplined direct execution can outperform extra ceremony.

    Treat the 0 / 6 / 37 comparison as a case study

    The original article cites Alex Rusin’s comparison of three approaches on one API feature. In that reported run, Plan Mode asked no questions and produced a plan in roughly ten minutes; Superpowers asked six focused questions and took more than 31 minutes before stalling; Grill Me asked 37 questions.

    Those figures are useful as a trace of how one configuration allocated decisions. They are not a benchmark. One feature, operator, model configuration, repository, and run cannot establish general speed or correctness. The projects have also changed since the test. Superpowers now has newer planning and review behavior; Grilling’s July 2026 releases added an explicit confirmation gate and a clearer facts-versus-decisions split.

    English graphic: one tool governs process while the other asks the user to clarify intent
    One tool governs a larger process; the other concentrates on clarification. English-localized derivative based on the original visual by 大刘 / AI大刘.
    English chart comparing Plan Mode, Superpowers, and Grill Me
    Alex Rusin’s cited case compares Plan Mode (0 questions, about 10 minutes), Superpowers (6 questions, 31+ minutes), and Grill Me (37 questions). It is an illustrative single run, not a general performance study. English-localized derivative based on the original visual by 大刘 / AI大刘.

    A risk-weighted decision matrix

    Choose the smallest workflow that covers the costly uncertainty—not the smallest workflow in absolute terms.

    Situation Useful default What must be true before execution
    Vague greenfield idea; domain owner available Grill Me High-impact choices are explicit and the user confirms shared understanding
    Existing codebase; decisions need a durable record Grill With Docs or equivalent Context, terminology, and architectural decisions are written down
    Multi-file or multi-component change with dependency order Superpowers or another structured planning stack Design is approved, interfaces are named, steps have verification and rollback boundaries
    Small local change following a stable pattern Lightweight plan and direct execution Scope is reversible and a reliable test or observable check exists
    Production write, security boundary, destructive migration, or external side effect Structured workflow plus explicit approval Blast radius, recovery path, owner, and final approval are unambiguous
    Large, multi-session problem whose shape is still unclear Discovery/decomposition workflow before implementation The problem is split into independently reviewable scopes

    A useful qualitative risk score is:

    planning intensity ≈ probability of a wrong assumption × cost of reversal × coordination surface

    This is not a numeric formula. It is a prompt to examine three independent reasons for more structure. High ambiguity raises the chance of choosing the wrong target. Irreversible or customer-visible effects raise the cost of being wrong. Many files, systems, sessions, or contributors raise the chance that a correct local change fails as a whole.

    The strongest workflow is a sequence

    For consequential work, the best combination is usually:

    1. Inspect before asking. Read project instructions, neighboring code, tests, logs, schemas, and recent decisions. Separate facts from owner-only choices.
    2. Grill only high-impact decisions. Ask one answerable question at a time, explain the recommended default, and record the decision as a constraint or acceptance criterion.
    3. Freeze a decision brief. Capture goal, non-goals, external behavior, interfaces, compatibility, data and permission boundaries, acceptance criteria, and actions that require renewed approval.
    4. Generate a dependency-aware plan. Map files and interfaces, sequence dependent changes, define RED/GREEN or equivalent checks, and place rollback or human gates at high-blast-radius steps.
    5. Execute in verifiable increments. Keep changes small enough that failures have a clear cause. Use independent review where the cost warrants it.
    6. Return evidence, not confidence. Show the diff, tests, logs, screenshots, citations, migration results, and unresolved risks before merge or publication.

    This sequence matches broader official guidance. Anthropic describes an agent loop of gathering context, taking action, and verifying results, and recommends giving Claude something concrete to verify against. OpenAI’s original Codex description likewise emphasizes isolated environments and iterative tests. The tools differ, but the control principle is stable: approval governs authority; verification governs trust.

    Stop grilling when

    • every decision that would change scope, architecture, external behavior, data, or permissions has an owner-approved answer;
    • goals, non-goals, and acceptance criteria are observable;
    • discoverable facts have been investigated instead of delegated back to the user;
    • remaining unknowns are local, reversible, or cheaply testable; and
    • it is clear which later actions require renewed approval.

    Start implementation when

    • each plan step has a concrete artifact or observable result;
    • verification commands and expected outcomes are present, not merely a list of files to edit;
    • high-risk steps have rollback or approval boundaries;
    • repository instructions contain current build, lint, test, and validation commands; and
    • a reviewer can tell from the plan what “done” means.

    What the evidence still cannot tell us

    No cited study directly compares current Superpowers, Grill Me, Grill With Docs, Claude Plan mode, and a lightweight baseline across the same production repositories and human teams. Function-level benchmarks underrepresent coordination and maintenance. Simulated users may answer more consistently than real stakeholders. SWE-bench variants emphasize issue resolution rather than product discovery. Project release notes report maintainers’ intentions and internal evaluations, not independent universal outcomes.

    That uncertainty should change how teams adopt these methods. Measure rework, elapsed time, human attention, escaped defects, review findings, and recovery cost on your own task mix. Do not use repository stars, plan length, token count, or question count as a substitute for outcome evidence.

    The most defensible conclusion is narrower and more useful: clarification reduces uncertainty about what should be built; planning manages dependencies in how it will be built; verification determines whether the result is acceptable. Match the depth of each layer to the cost of being wrong.

    Sources and attribution