Forma Starter Kit Evaluation Suite

Purpose

This suite defines project-level validation cases for examples/getting-started-workspace. The starter workspace should remain clean and copyable for users, while these test cases live in the Forma project knowledge base as evaluation assets.

This suite is reusable evidence for internal release review through metrics/knowledge-workflow-replacement-readiness.

Contract Tests

• test-cases/forma-starter-kit/starter-config-contract
• test-cases/forma-starter-kit/starter-health-contract
• test-cases/forma-starter-kit/starter-guideline-discovery-contract
• test-cases/forma-starter-kit/starter-skill-interface-contract
• test-cases/forma-starter-kit/starter-schema-quality-contract
• test-cases/forma-starter-kit/numeric-schema-type-contract

Agent Pressure Tests

• test-cases/forma-starter-kit/starter-task-selection-pressure
• test-cases/forma-starter-kit/starter-agent-skill-behavior-pressure
• test-cases/forma-starter-kit/starter-blocked-to-done-pressure
• test-cases/forma-starter-kit/starter-review-to-done-pressure
• test-cases/forma-starter-kit/starter-write-verify-pressure
• test-cases/forma-starter-kit/starter-local-only-promotion-pressure
• test-cases/forma-starter-kit/starter-language-variant-pressure

Skill Mode Bootstrap

Agent-facing tests should exercise the current Forma skill mode:

1. Load the built-in CLI guide with cargo run -q -p forma-cli -- --workspace examples/getting-started-workspace skills get forma-cli-core.
2. Discover workspace-projected skills with cargo run -q -p forma-cli -- --workspace examples/getting-started-workspace skills list --json.
3. Load getting-started-workspace-operations for starter knowledge, local-only, language-variant, and write-classification workflows.
4. Load getting-started-task-selection for starter task selection, blocker, review, and status workflows.
5. Use --workspace examples/getting-started-workspace whenever the Agent is not executing from the starter workspace root.

Evaluation Boundary

• Keep evaluation assets outside examples/getting-started-workspace so users can copy the starter without test-only material.
• Use the starter workspace to validate Forma product principles, CLI/RPC contracts, WebApp behavior, and the forma-cli skill gate.
• Do not copy this repository's project knowledge structure into the starter unless the structure is also a product-level starter recommendation.