Add council-review skill gap-fill test plans

2026-03-19 17:59:58 +08:00
parent 0b533a70f9
commit d17b5ebfbd
8 changed files with 561 additions and 4 deletions
@@ -0,0 +1,62 @@
+# Title
+
+Expand Council Review Skill Test Plan Coverage
+
+## Status
+
+- `completed`
+
+## Owner
+
+- Codex main agent
+
+## Started At
+
+- `2026-03-19`
+
+## Goal
+
+- Add the next batch of high-value `docs/tests/council-review-skill/` forward-test cases to cover important council workflow gaps beyond the initial smoke suite.
+
+## Scope
+
+- Update `docs/tests/council-review-skill/README.md` with the expanded case index.
+- Add five new council-review skill case documents.
+- Update `docs/implementation-roadmap.md` to reflect the broader skill test-plan coverage.
+
+## Checklist
+
+- [x] Identify the highest-value uncovered council-review skill scenarios.
+- [x] Update the council-review skill README case index.
+- [x] Author the five new case documents.
+- [x] Update implementation roadmap and archive this execution roadmap.
+
+## Files
+
+- `docs/tests/council-review-skill/README.md`
+- `docs/tests/council-review-skill/council-report-show-all-includes-minority-through-bundled-cli.md`
+- `docs/tests/council-review-skill/council-report-rejects-invalid-show-through-bundled-cli.md`
+- `docs/tests/council-review-skill/council-tally-strict-keeps-distinct-proposals-through-bundled-cli.md`
+- `docs/tests/council-review-skill/council-reviewer-output-invalid-json-fails-tally-through-bundled-cli.md`
+- `docs/tests/council-review-skill/council-start-with-target-file-through-bundled-cli.md`
+- `docs/implementation-roadmap.md`
+- `docs/roadmaps/archive/council-review-skill-gap-fill.md`
+
+## Decisions
+
+- Prioritize skill-level scenarios that add real workflow coverage rather than mechanically duplicating every lower-level `orch council` contract.
+- Focus the gap fill on explicit report filtering, strict tally semantics, malformed reviewer output, and non-prompt target context.
+
+## Blockers
+
+- none
+
+## Next Step
+
+- Capture recorded example runs or direct CLI replays for the new council-review skill cases when execution evidence is needed.
+
+## Completion Summary
+
+- Expanded `docs/tests/council-review-skill/README.md` so the shared execution contract now explicitly covers target-file fixtures and indexes the five new gap-fill cases.
+- Added five forward-test case documents covering explicit `--show all` minority reporting, invalid `--show` rejection, strict tally semantics, malformed reviewer JSON at tally time, and target-file council start inputs.
+- Updated `docs/implementation-roadmap.md` to record that the council-review skill test-plan directory now covers nine workflow scenarios rather than only the initial smoke suite.