71 lines
2.1 KiB
Markdown
71 lines
2.1 KiB
Markdown
# Repo Memory Skill Test Plan
|
|
|
|
## Purpose
|
|
|
|
This directory tracks human-readable test plans for the `skills/repo-memory/`
|
|
Codex skill bundle.
|
|
|
|
These documents are not package-level unit tests for `briefdb`.
|
|
Those live with the runtime under `packages/repo-memory-runtime/`.
|
|
|
|
This directory covers a different surface:
|
|
|
|
- whether an agent can actually use the packaged `repo-memory` skill
|
|
- whether the bundled `./assets/briefdb` CLI works inside real skill-guided
|
|
repository work
|
|
- whether durable repository knowledge is stored and retrieved correctly
|
|
|
|
## Test Model
|
|
|
|
- `README.md` is the index for this directory
|
|
- each skill test case lives in its own Markdown file
|
|
- use stable case slugs in filenames
|
|
|
|
## Shared Execution Contract
|
|
|
|
Use these defaults unless a case file explicitly overrides them:
|
|
|
|
- run the scenario with one real agent using the bundled `repo-memory` skill
|
|
- create an isolated temporary directory, repository fixture, and SQLite DB path
|
|
- require the agent to use the bundled `./assets/briefdb` CLI instead of ad hoc
|
|
notes
|
|
- validate final database state independently from the main thread after the
|
|
agent stops
|
|
|
|
## Per-Case Template
|
|
|
|
Each case file should use this structure:
|
|
|
|
- `Test Type`
|
|
- `Purpose`
|
|
- `Preconditions`
|
|
- `Inputs`
|
|
- `Execution Parameters`
|
|
- `Execution Steps`
|
|
- `Validation Commands`
|
|
- `Expected Outcomes`
|
|
- `Assertions`
|
|
- `Cleanup`
|
|
- `Recorded Example Run` when a real run has already been captured
|
|
|
|
## Case Files
|
|
|
|
| Case Slug | File | Coverage Note |
|
|
| --- | --- | --- |
|
|
| `search-and-add-through-bundled-cli` | [search-and-add-through-bundled-cli.md](./search-and-add-through-bundled-cli.md) | validates that an agent can miss on search, add one durable entry, then retrieve it through the packaged `repo-memory` skill |
|
|
|
|
## Scope
|
|
|
|
In scope:
|
|
|
|
- explicit `$repo-memory` skill invocation
|
|
- bundled `./assets/briefdb` CLI usage
|
|
- durable knowledge add/search/list/event flows
|
|
- package-backed SQLite memory database behavior as surfaced through the skill
|
|
|
|
Out of scope:
|
|
|
|
- package-level unit tests for `briefdb`
|
|
- future auto-export flows such as `repo-brief` generation
|
|
- implicit skill triggering without `$repo-memory`
|