67 lines
2.6 KiB
Markdown
67 lines
2.6 KiB
Markdown
# Title
|
|
|
|
Direct Replay For Orch Skill Cases
|
|
|
|
## Status
|
|
|
|
- `completed`
|
|
|
|
## Owner
|
|
|
|
- codex
|
|
|
|
## Started At
|
|
|
|
- `2026-03-19`
|
|
|
|
## Goal
|
|
|
|
- Execute the documented `docs/tests/orch-skill/` scenarios against the bundled `skills/orch/assets/orch` and `skills/inbox/assets/inbox` binaries, capture concrete evidence, and sync the repo docs with the observed results.
|
|
|
|
## Scope
|
|
|
|
- add a reusable local runner for the five documented orch-skill scenarios
|
|
- run the scenarios and capture per-case evidence
|
|
- update the orch-skill docs with recorded runs and note the execution mode
|
|
- update the implementation roadmap to reflect the new replay coverage
|
|
|
|
## Checklist
|
|
|
|
- [x] Review the orch-skill case docs and bundled CLI surfaces.
|
|
- [x] Add a reusable direct replay runner for the five orch-skill scenarios.
|
|
- [x] Execute the runner and collect evidence for all five cases.
|
|
- [x] Update the orch-skill docs with recorded example runs and execution notes.
|
|
- [x] Update the implementation roadmap and archive this execution roadmap.
|
|
|
|
## Files
|
|
|
|
- `scripts/run_orch_skill_forward_tests.sh`
|
|
- `docs/tests/orch-skill/README.md`
|
|
- `docs/tests/orch-skill/leader-run-dispatch-reconcile-through-bundled-cli.md`
|
|
- `docs/tests/orch-skill/leader-blocked-answer-resume-through-bundled-cli.md`
|
|
- `docs/tests/orch-skill/strict-worktree-dispatch-to-cleanup-through-bundled-cli.md`
|
|
- `docs/tests/orch-skill/leader-retries-failed-task-through-bundled-cli.md`
|
|
- `docs/tests/orch-skill/leader-reassigns-blocked-task-through-bundled-cli.md`
|
|
- `docs/implementation-roadmap.md`
|
|
- `docs/roadmaps/archive/orch-skill-direct-replay.md`
|
|
|
|
## Decisions
|
|
|
|
- Use direct bundled-CLI replay instead of spawning Codex role agents in this turn, because the current session does not permit sub-agent delegation unless the user explicitly asks for it.
|
|
- Keep the replay runner repo-local so the same scenarios can be rerun later without reconstructing the command flow by hand.
|
|
|
|
## Blockers
|
|
|
|
- none
|
|
|
|
## Next Step
|
|
|
|
- rerun `scripts/run_orch_skill_forward_tests.sh` when the bundled skill binaries or orch-skill case docs change, and add true multi-agent forward coverage later if explicit sub-agent execution is needed
|
|
|
|
## Completion Summary
|
|
|
|
- Added `scripts/run_orch_skill_forward_tests.sh` as a reusable direct bundled-CLI replay runner for the five documented orch-skill scenarios.
|
|
- Executed the runner on `2026-03-19`; all five scenarios passed and produced per-case JSON evidence under a temporary output root.
|
|
- Updated `docs/tests/orch-skill/README.md` plus all five case files with recorded example runs and explicit execution-mode notes.
|
|
- Updated `docs/implementation-roadmap.md` to record the new replay runner and captured orch-skill execution evidence.
|