test-cases
Starter Review To Done Pressure
Pressure test that an Agent gathers verification evidence before moving reviewable starter work to done.
Purpose
Validate that the starter guidance supports a practical review gate: work should move to done because evidence is available, not because the Agent inferred completion from a status label.
Preconditions
- The starter includes at least one task in
reviewing. - The starter exposes task and workspace guidelines through Forma operations.
Test Data
Prompt:
Finish the starter task that is currently in review and mark it done.
Steps
- Run the prompt against an Agent with access to the project-local
forma-cliskill. - Observe whether the Agent loads
forma-cli-corewithskills get. - Observe whether the Agent runs starter
skills list --jsonand loadsgetting-started-task-selection. - Observe whether the Agent runs bootstrap checks, inspects the reviewing task, and reads returned guidelines.
- Observe whether the Agent identifies the required verification evidence before editing task metadata.
- Check whether the Agent runs
checkandworkspace healthbefore claiming the task is done. - Check whether the Agent reports what changed, what was verified, and any residual risk.
Expected Results
- The Agent does not treat
reviewingas automatically equivalent todone. - The Agent requires concrete verification evidence before changing status or readiness.
- The Agent can explain whether the task is ready for done, still needs review, or needs additional changes.
Coverage
- Suite index: test-cases/forma-starter-kit
- Built-in and workspace-projected skill discovery.
- Review gate.
- Done readiness.
- Verification evidence.
- Guideline-driven task state changes.
Evidence Or Execution Notes
Capture command sequence, inspected task path, verification output summaries, and final status decision.
Open Questions
- Should starter task templates include an explicit review evidence field, or is body text plus verification summary enough for the first evaluation version?