tasks
Define External Forma Product Value Validation
Define a comparative external pilot that tests whether Forma reduces knowledge and Agent failures beyond disciplined Markdown and scripts.
Goal
Define a small comparative pilot that can raise or lower confidence in Forma's value versus well-designed Markdown, editor features, lightweight scripts, and generic coding Agents.
Observed Baseline
Internal dogfooding and starter-kit pressure validation prove technical mechanics and Agent discoverability. They do not measure external setup cost, recurring use, time saved, errors prevented, or willingness to keep Forma in a real workflow.
Initial Case Corpus
The first protocol uses two user-authorized published case narratives from the choral-io/knowledge-research repository as qualitative inputs, not as pre-counted pilot results:
- From knowledge-workflow to Forma identifies the cost of carrying software-engineering knowledge mechanics into content, sales, professional-service, and operations domains.
- From documents to knowledge assets describes a professional-services trial in which structured records, evidence, review boundaries, and recurring maintenance improve reuse without delegating professional judgment to an Agent.
The pilot must collect the same evidence in a comparable shape before treating either narrative as support for a product-value claim.
In Scope
- Define participant and repository criteria for three to five external teams or maintainers.
- Establish a disciplined Markdown baseline before introducing Forma.
- Measure setup/support time, schema/reference failures caught, Agent rework, task completion time, feature use, and continued weekly use.
- Separate source portability value from runtime/projection value.
- Define privacy, consent, evidence retention, success thresholds, and stop criteria.
- Repeat the pilot after guided modeling and safe-write milestones rather than waiting for every roadmap item.
Out Of Scope
- Claiming market fit from release downloads or internal dogfooding.
- Broad market research, pricing, or a growth campaign.
- Collecting product telemetry without explicit design and consent.
- Selecting only repositories already optimized for Forma.
Acceptance Criteria
- The comparison protocol, cohort criteria, measures, and stop conditions are explicit.
- Baseline and Forma-assisted workflows use the same representative jobs.
- Qualitative findings are separated from measured outcomes.
- A future experiment and metric record can capture results without changing the protocol.
- Results can recommend continue, narrow, reposition, or stop for each roadmap claim.
Sequencing
Define the baseline alongside guided modeling. Run the first meaningful external comparison after guided modeling and import/normalization provide a complete adoption path.