3.1 KiB
3.1 KiB
Orch Markdown Test Plan
Purpose
This directory contains the human-readable Markdown test plan for the orch CLI.
It complements automated Go tests. The goal is to preserve the user-visible scheduler contract in a form that can be reviewed, extended, and executed manually without re-deriving command behavior from implementation code.
Directory Rules
- one folder per
orchleaf command or shared area - each folder keeps a
README.mdentrypoint - command folders use
README.mdas an index only - each command test case lives in its own Markdown file named after the case slug
- no numeric test IDs
- each command case is identified by its concrete file path
Case file naming pattern:
<case-slug>.md
Authoring Principles
- focus on externally visible CLI behavior rather than store internals
- prefer stable command sequences that a new agent can replay against a temp database
- document both success contracts and failure boundaries
- reuse scenarios from automated
orchintegration tests before inventing new cases - keep terminology consistent with the scheduler concepts exposed by
orch: run, task, dependency, attempt, blocked task, worktree, and council review
Common Execution Model
Most cases in this directory assume the same baseline:
- create an isolated temporary directory
- choose a database path such as
TMPDIR/coord.db - run the target
orchcommand sequence with--db TMPDIR/coord.db --json - when a case needs worker-side state transitions, drive them through
inboxagainst the same database
Unless a case says otherwise:
- commands should use
--json - assertions should check both exit code and JSON payload
orchmay be pointed at an empty database path; schema bootstrapping happens automatically on open
Folder Map
README.md: global conventions and glossaryROADMAP.md: document progress, planned case backlog, and authored-case register_shared/README.md: reusable fixtures, JSON assertions, exit-code rules, and worktree conventionsworkflows/README.md: cross-command end-to-end scenarios- per-command folders: one leaf-command directory per implemented
orchcommand surface
Glossary
run: one coordinated execution for a user requesttask: one schedulable unit of work inside a rundependency: an edge that gates one task on anotherattempt: one execution try for a taskdispatch: the act of materializing a task into an inbox threadworkspace: the branch and worktree assigned to a code-writing attemptblocked task: a task whose active attempt requires clarification or another external decisioncouncil review: a higher-level workflow built on top oforchthat dispatches fixed reviewer roles and tallies recommendations
Relationship To Automated Tests
The current best executable reference is integration_test.go.
When this Markdown plan expands:
- prefer matching an existing automated scenario first
- record any additional manual-only contract coverage explicitly in the relevant command case file
- keep ROADMAP.md synchronized with authored files and case slugs