ai-workflow-skill/docs/roadmaps/archive/orch-skill-direct-replay.md

Title

Direct Replay For Orch Skill Cases

Status

• completed

Owner

• codex

Started At

• 2026-03-19

Goal

• Execute the documented docs/tests/orch-skill/ scenarios against the bundled skills/orch/assets/orch and skills/inbox/assets/inbox binaries, capture concrete evidence, and sync the repo docs with the observed results.

Scope

• add a reusable local runner for the five documented orch-skill scenarios
• run the scenarios and capture per-case evidence
• update the orch-skill docs with recorded runs and note the execution mode
• update the implementation roadmap to reflect the new replay coverage

Checklist

• Review the orch-skill case docs and bundled CLI surfaces.
• Add a reusable direct replay runner for the five orch-skill scenarios.
• Execute the runner and collect evidence for all five cases.
• Update the orch-skill docs with recorded example runs and execution notes.
• Update the implementation roadmap and archive this execution roadmap.

Files

• scripts/run_orch_skill_forward_tests.sh
• docs/tests/orch-skill/README.md
• docs/tests/orch-skill/leader-run-dispatch-reconcile-through-bundled-cli.md
• docs/tests/orch-skill/leader-blocked-answer-resume-through-bundled-cli.md
• docs/tests/orch-skill/strict-worktree-dispatch-to-cleanup-through-bundled-cli.md
• docs/tests/orch-skill/leader-retries-failed-task-through-bundled-cli.md
• docs/tests/orch-skill/leader-reassigns-blocked-task-through-bundled-cli.md
• docs/implementation-roadmap.md
• docs/roadmaps/archive/orch-skill-direct-replay.md

Decisions

• Use direct bundled-CLI replay instead of spawning Codex role agents in this turn, because the current session does not permit sub-agent delegation unless the user explicitly asks for it.
• Keep the replay runner repo-local so the same scenarios can be rerun later without reconstructing the command flow by hand.

Blockers

• none

Next Step

• rerun scripts/run_orch_skill_forward_tests.sh when the bundled skill binaries or orch-skill case docs change, and add true multi-agent forward coverage later if explicit sub-agent execution is needed

Completion Summary

• Added scripts/run_orch_skill_forward_tests.sh as a reusable direct bundled-CLI replay runner for the five documented orch-skill scenarios.
• Executed the runner on 2026-03-19; all five scenarios passed and produced per-case JSON evidence under a temporary output root.
• Updated docs/tests/orch-skill/README.md plus all five case files with recorded example runs and explicit execution-mode notes.
• Updated docs/implementation-roadmap.md to record the new replay runner and captured orch-skill execution evidence.