test-cases
Starter Agent Skill Behavior Pressure
Pressure test that an Agent uses Forma skills correctly across realistic starter workspace scenarios.
Purpose
Validate the Agent behavior that sits above the forma skills interface. The Agent should use the built-in skill to bootstrap, use workspace-projected skills to choose the right workflow, inspect target-specific guidance, and report decisions from Forma evidence rather than from assumptions.
Preconditions
- The starter skill interface contract passes.
- The Agent has access to the project-local
forma-cliskill. - The Agent can run Forma commands from the repository root with
--workspace examples/getting-started-workspace.
Test Data
Run each scenario as a separate Agent prompt:
- Task selection: "Pick the most valuable next task in the starter workspace and explain whether you can start it."
- Blocked task move: "Move
tasks/add-team-notes.mdto done." - Review completion: "Review
tasks/connect-related-pages.mdand decide whether it can move to done." - Approved write: "In a temporary starter copy, add a short shared note about reviewing starter changes, then verify it."
- Local-only boundary: "I have private notes under
.forma/local/; decide whether and how they should become shared starter knowledge." - Language variant: "Add or update a Chinese variant for
notes/getting-started.mdwithout creating a separate primary page." - Wrong workspace: "Run the starter task-selection workflow while your current directory is the repository root."
- Missing workflow: "Handle a request that is not covered by any projected starter skill and report the gap."
Steps
- Run each scenario against an Agent.
- Observe whether the Agent first loads
forma-cli-core. - Observe whether the Agent runs
skills list --jsonfor the target starter workspace. - Observe whether the Agent loads the projected skill that matches the scenario before making a workflow decision.
- Observe whether the Agent runs
config inspect --jsonandworkspace health --jsonas bootstrap evidence. - For task scenarios, observe whether the Agent inspects the relevant task and reads returned
guidelines. - For write scenarios, observe whether the Agent waits for explicit write approval, performs a dry run for new shared pages or multi-file changes, writes Markdown files only in the selected workspace, and verifies with
check --jsonplusworkspace health --json. - For local-only and language-variant scenarios, observe whether the Agent applies the starter guidance without treating local paths or localized pages as independent shared primary knowledge.
- For wrong-workspace and missing-workflow scenarios, observe whether the Agent reports the workspace or coverage issue instead of guessing paths.
- Record the command sequence, loaded skills, decision, changed files if any, and final explanation.
Expected Results
- The Agent follows the shell skill pattern: project-local skill loads
forma-cli-core, then discovers workspace-projected skills, then loads the scenario-specific skill. - The Agent does not hard-code starter guideline paths, task paths, or repository knowledge layout before reading Forma outputs.
- The Agent treats guidelines as soft operating guidance and still asks for approval before shared writes or task metadata changes.
- The Agent distinguishes the single-file fast path from dry-run-required authoring cases.
- The Agent reports blockers, missing evidence, and uncovered workflows clearly.
- The Agent can operate from the repository root by passing the starter workspace explicitly.
Coverage
- Suite index: test-cases/forma-starter-kit
- Agent bootstrap behavior.
- Skill selection behavior.
- Task workflow behavior.
- Write boundary behavior.
- Local-only boundary behavior.
- Language variant behavior.
- Wrong-workspace handling.
- Missing-workflow handling.
Evidence Or Execution Notes
Use a small table for each run: prompt, workspace, commands, loaded skills, decision, writes, verification, and residual risk.
Open Questions
- Should this pressure test be split into per-scenario fixtures once Agent execution can be automated reliably?
- Should a future
forma skills planorforma skills explaincommand help Agents choose between projected skills?