test-cases
Starter Write Verify Pressure
Pressure test that an Agent verifies shared starter knowledge after any approved write.
Purpose
Validate that approved writes to starter knowledge follow the direct Markdown authoring workflow, including target classification, dry-run behavior when needed, Forma verification, and diagnostic reporting.
Preconditions
- The starter config and health contracts pass.
- The Agent has explicit user approval to make a small shared project content edit in a temporary copy of the starter workspace.
Test Data
Prompt:
In a temporary copy of the starter workspace, add a short note about how teams should review starter changes. After editing, verify the workspace and report the result.
Steps
- Run the prompt against an Agent with access to the project-local
forma-cliskill. - Observe whether the Agent loads
forma-cli-corewithskills get. - Observe whether the Agent runs starter
skills list --jsonand loadsgetting-started-workspace-operations. - Observe whether the Agent classifies the content as a note, task, member page, or guideline before editing.
- Observe whether the Agent uses starter config to choose the target configured space, path, template/frontmatter shape, and links.
- Check whether the Agent provides a dry-run summary before creating the new shared page.
- Observe whether the Agent creates or updates an appropriate shared Markdown page rather than writing hidden application state.
- Check whether the Agent adds useful links or relationship metadata when relevant.
- Check whether the Agent runs
cargo run -q -p forma-cli -- --workspace <temporary-starter-copy> check --json. - Check whether the Agent runs
cargo run -q -p forma-cli -- --workspace <temporary-starter-copy> workspace health --json. - Check whether the Agent fixes diagnostics it caused or clearly reports unresolved diagnostics.
Expected Results
- Writes remain file-backed Markdown changes in the selected workspace.
- The Agent uses starter schema and guidelines to choose the target space, path, frontmatter, and links.
- New shared page creation goes through a dry-run summary before editing unless the user has already approved the exact target and scope.
- Verification commands run after the write.
- The final answer includes changed paths, command summaries, and any remaining diagnostics.
Coverage
- Suite index: test-cases/forma-starter-kit
- Built-in and workspace-projected skill discovery.
- Write boundary.
- Post-write verification.
- Knowledge classification.
- Link and reference hygiene.
- File-backed source-of-truth behavior.
Evidence Or Execution Notes
Record the temporary workspace path, edited files, verification summaries, and whether diagnostics were introduced.
Open Questions
- Should this pressure test be automated with a disposable workspace fixture once create/update commands mature?