[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6ACKHPW268MEH4MYY0Q91W1":3,"skill-same:01M6ACKHPW268MEH4MYY0Q91W1":71},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":37,"linkOnly":38,"markdownContent":39,"markdownBody":40,"frontMatter":41,"refName":48,"commitSha":49,"skillDirectory":50,"forksCount":51,"repositoryHtmlUrl":52,"repositoryHomepageUrl":53,"ownerHtmlUrl":54,"ownerBlogUrl":55,"ownerDescription":6,"updatedAt":56,"install":57,"resources":70},"01M6ACKHPW268MEH4MYY0Q91W1","hamilton-observability",null,"Hamilton UI and SDK patterns for tracking, monitoring, and debugging dataflows. Use for observability, lineage tracking, and production monitoring.","apache\u002Fhamilton","apache","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F47359?v=4","01M6AC83E6K4FDKK7HZ8WNMQKE","The Apache Software Foundation","01M6ACK0BE2X7FDAV10PJHXW1W",2630,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton\u002Fblob\u002Fmain\u002F.claude-plugin\u002Fskills\u002Fobservability\u002FSKILL.md",[],[19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36],"observability","hamilton observability","Bash","for","true","false","patterns","use","tracking","read","grep","python","Production","monitoring","ui","lineage","debugging","sdk","2026-11-10 10:12:30",false,"---\nname: experiment\ndescription: Design lean validation experiments — hypothesis, method, success criteria, sample size, timeline, and decision rules\ntype: planning\nversion: v0.4\nargument-hint: \u003Chypothesis or assumption to test>\ninterview_depth: light\n---\n\n## Pack Availability Guard\n\nBefore telling the user to run a skill from another project-local pack, check `.agents\u002Fproject.json.enabled_packs`. If the target pack is not enabled, recommend `$pack install \u003Cpack>` instead of the target skill. Global skills are always valid. Skills from this same pack are valid because the current skill is already running from that pack.\n\n# Experiment — Lean Validation Design\n\nTakes a hypothesis (from `$assumption-tracker` or user) and designs a cheap, fast validation experiment. Covers landing page tests, fake-door tests, concierge MVPs, surveys, A\u002FB tests, pricing tests, and smoke tests. Outputs a structured plan with hypothesis, method, success criteria, sample size, timeline, and decision rules.\n\n## Soft Prerequisites\n\n- Read `research\u002Fassumption-tracker.md` if it exists — pulls the highest-priority unvalidated assumption\n- Read `research\u002Ficp.md` if it exists — grounds experiment design in who the target is\n- Read `research\u002Fmetrics.md` if it exists — aligns success criteria with existing metric definitions\n- Read `research\u002Fgtm.md` if it exists — leverages channel strategy for reaching test subjects\n\n## Process\n\n### 0. Product-Path Scope Resolution\n\nResolve research scope by product path before using code or app structure as a hint:\n\n1. If `$ARGUMENTS` names a non-archived `research\u002F{slug}\u002F` directory or a product-path ID whose `scope_path` points there, use that path. Treat `{slug}` as the product\u002Fapp name, not the ICP, audience, or segment label.\n2. If `$ARGUMENTS` names only `research\u002F_archive\u002F{slug}\u002F` or a manifest entry with `status: archived` or legacy `status: abandoned`, stop and warn that the path is archived; do not write or update scoped outputs there.\n3. Read `research\u002F.progress.yaml` when present. Normalize legacy `active_path` to `active_paths` on read and write back `active_paths` on manifest updates. Treat legacy `abandoned` as `archived`; exclude `archived`, `abandoned`, `deferred`, `revisit_candidate`, `promoted`, and any `scope_path` under `research\u002F_archive\u002F` from active target selection.\n4. If active product paths exist in the manifest, use those paths. If multiple active paths exist, ask which one to target unless this skill explicitly supports cross-path output.\n5. If no active manifest target exists, list non-archived product directories under `research\u002F`, excluding `research\u002F_archive\u002F` and dot directories. Auto-select only when exactly one exists; ask when multiple exist.\n6. If no product directories exist, use flat `research\u002F` single-product mode.\n7. Detect monorepo\u002Fapp\u002Fpackage structure only as a secondary hint. Suggest creating a missing `research\u002F{slug}\u002F` product path when code clearly exposes an app, but do not require code or monorepo detection before using `research\u002F{slug}\u002F`.\n\nWhen product path `{slug}` is active, read and write research under `research\u002F{slug}\u002F`, specs under `specs\u002F{slug}\u002F`, and treat top-level `research\u002F*.md` files as flat-mode documents or cross-path summaries.\n\n### 1. Product Path Manifest\n\nRead `research\u002F.progress.yaml` when present. Normalize `active_path` (singular legacy) to `active_paths` (plural list) when reading; treat legacy `abandoned` as `archived` and exclude archived\u002Fdeferred\u002Frevisit\u002Fpromoted paths plus `research\u002F_archive\u002F` scopes from active target selection. Scope experiment design to the active product path by default. When experiment results validate or invalidate assumptions about a deferred product path, add a `## Product Path Implications` section recommending `$product-line activate` or `$product-line archive` as appropriate.\n\n### 2. Parse Input & Load Context\n\n**Read `$ARGUMENTS`:**\n- If it's a specific hypothesis or assumption: use it directly\n- If it's a reference to an assumption number (e.g., \"#3\"): look it up in `research\u002Fassumption-tracker.md`\n- If empty: check `research\u002Fassumption-tracker.md` for the highest-priority unvalidated assumption. If no tracker exists, ask the user what they want to test. If the session is already in Plan mode and there are 2-3 concrete choices, prefer `request_user_input`.\n\n**Load context:** Read available research docs to understand the ICP, channels, metrics, and existing knowledge.\n\n### 3. Structure the Hypothesis\n\nConvert the input into a structured hypothesis:\n\n**Format**: \"We believe that [target segment] will [expected behavior] because [rationale]. We'll know this is true when [measurable outcome].\"\n\nPresent and refine with the user. If the session is already in Plan mode and there are 2-3 concrete choices, prefer `request_user_input`; otherwise ask in plain text:\n- \"Here's how I've structured the hypothesis. Does this capture what you want to test?\"\n- If the hypothesis is too broad, help narrow it to something testable in 1-2 weeks\n\n### 4. Research Experiment Methods\n\nUse WebSearch with **3-5 targeted queries** to find best practices for this type of validation:\n\n1. **Method-specific** — \"[experiment type] validation method\", \"how to test [hypothesis type]\"\n2. **Sample size** — \"[experiment type] sample size calculator\", \"minimum viable test size\"\n3. **Benchmarks** — \"[category] conversion rate benchmark\", \"[experiment type] typical results\"\n4. **Tools** — \"[experiment type] tools\", \"cheapest way to test [hypothesis]\"\n\n### 5. Design the Experiment — Present & Validate\n\nSelect the most appropriate experiment type and design the full plan:\n\n#### Experiment Types\n\n| Type | Best For | Timeline | Cost |\n|------|----------|----------|------|\n| **Landing page test** | Demand validation, messaging | 1-2 weeks | $50-200 (ads) |\n| **Fake-door test** | Feature demand, willingness to explore | 1 week | $0 (in-product) |\n| **Concierge MVP** | Value delivery, willingness to pay | 2-4 weeks | Time only |\n| **Survey** | Broad sentiment, preference ranking | 3-5 days | $0-100 |\n| **A\u002FB test** | Optimization, messaging variants | 1-2 weeks | $0 (in-product) |\n| **Pricing test** | Willingness to pay, price sensitivity | 1-2 weeks | $50-200 |\n| **Smoke test** | Demand for non-existent feature | 3-5 days | $0-50 |\n| **Pre-sale \u002F LOI** | B2B willingness to pay | 1-2 weeks | Time only |\n| **Wizard of Oz** | Complex feature viability | 2-4 weeks | Time only |\n\n**Present the experiment design to the user.** If the session is already in Plan mode, prefer `request_user_input`; otherwise ask in plain text. Show:\n- Recommended experiment type with rationale (why this method over alternatives)\n- Detailed plan with timeline and cost estimate\n- Success criteria with specific numbers (citing benchmarks from research)\n- Decision rules for both outcomes\n\nAsk:\n- \"Does this experiment design feel feasible? Too ambitious or too simple?\"\n- \"Any resource constraints I should know about? (budget, time, access to users)\"\n\nIncorporate feedback before proceeding.\n\n### 6. Define Decision Rules\n\nFor each possible outcome, define what happens next:\n\n- **If hypothesis is validated** (success criteria met): What's the next step? (e.g., build the feature, commit to the pricing, double down on the channel)\n- **If hypothesis is invalidated** (criteria not met): What's the pivot? (e.g., test alternative, revisit ICP, change approach)\n- **If results are inconclusive** (between thresholds): What additional data is needed? Run a follow-up experiment or extend the current one?\n\n### 7. Populate Next Steps\n\nInclude a **Recommended** item for the current design-stage next step, followed by **Other options**. Separate current next steps from outcome-specific next steps:\n\nUse this format in the output:\n\n```markdown\n## Next Steps\n\n**Recommended:** Run the experiment — the plan is only useful after the evidence is collected\n\nOther options:\n- [2-4 applicable alternatives]\n```\n\n- ALWAYS: Run the experiment (manual step — the plan tells you how)\n- For a newly designed experiment, do not list validation\u002Finvalidation commands as current top-level next steps; put those under `## Decision Rules` because they are only valid after results exist.\n- In `### If Validated`: include the next valid command, usually `$customer-feedback [results]` to log evidence, `$assumption-tracker` to mark the assumption validated, or `$roadmap` if the result commits the team to build.\n- In `### If Invalidated`: include `$assumption-tracker` to mark the assumption invalidated, plus `$brainstorm`, `$customer-discovery`, `$gtm`, or `$monetization` only when the failed assumption belongs to that domain.\n- In `### If Inconclusive`: include `$experiment [follow-up]` if the test needs another run, or `$customer-feedback` if qualitative evidence is the missing signal.\n- IF more assumptions remain untested after this design: `$experiment [next assumption]` — Design the next experiment\n- IF enough assumptions are validated after completed results: `$research-roadmap` — Check if research docs need updating based on learnings\n\n### 8. Write Output\n\nPresent final plan to user. Ask:\n- \"Ready to write this experiment plan? Anything to adjust?\"\n\nOnly after confirmation, write the output file.\n\n## Output\n\n### `research\u002Fexperiments\u002F[experiment-name].md` (or `research\u002F{slug}\u002Fexperiments\u002F[experiment-name].md`)\n\n```markdown\n# Experiment: [Descriptive Name]\n\n> Date designed: [current date]\n> Status: Designed | Running | Completed\n> Assumption: [from assumption-tracker, if applicable — include # reference]\n> Priority: [from assumption-tracker score, if applicable]\n\n## Hypothesis\n\n**We believe that** [target segment]\n**will** [expected behavior]\n**because** [rationale from research]\n\n**We'll know this is true when** [measurable outcome with specific threshold]\n\n## Method\n\n**Type**: [Landing page test \u002F Fake-door \u002F Concierge MVP \u002F Survey \u002F A\u002FB test \u002F Pricing test \u002F Smoke test \u002F Pre-sale \u002F Wizard of Oz]\n**Why this method**: [rationale — why this is the cheapest\u002Ffastest way to test this hypothesis]\n\n### Setup\n[Step-by-step instructions for setting up the experiment]\n\n1. [Step 1]\n2. [Step 2]\n3. ...\n\n### Tools Needed\n- [Tool 1] — [purpose]\n- [Tool 2] — [purpose]\n\n### Audience\n**Who**: [specific segment from ICP]\n**How to reach them**: [channel — from GTM if available]\n**Sample size**: [number needed for statistical significance]\n**Recruitment method**: [how to get participants]\n\n## Success Criteria\n\n| Metric | Failure | Inconclusive | Success |\n|--------|---------|--------------|---------|\n| [Primary metric] | \u003C [threshold] | [range] | ≥ [threshold] |\n| [Secondary metric] | \u003C [threshold] | [range] | ≥ [threshold] |\n\n**Benchmarks**: [what industry\u002Fcompetitor data says is typical]\n\n## Timeline\n\n| Phase | Duration | Tasks |\n|-------|----------|-------|\n| Setup | [days] | [what to prepare] |\n| Run | [days] | [data collection period] |\n| Analyze | [days] | [how to analyze results] |\n| **Total** | **[days]** | |\n\n## Budget\n\n| Item | Cost |\n|------|------|\n| [item] | [amount] |\n| **Total** | **[amount]** |\n\n## Decision Rules\n\n### If Validated (success criteria met)\n[Specific next actions — what to build, commit to, or double down on]\n\n### If Invalidated (failure criteria met)\n[Specific pivot — what to change, test next, or abandon]\n\n### If Inconclusive\n[What additional data is needed, whether to extend or redesign]\n\n## Results\n\n> Fill this section after the experiment completes.\n\n**Status**: [Validated \u002F Invalidated \u002F Inconclusive]\n**Date completed**: [date]\n\n### Raw Data\n[Key numbers and observations]\n\n### Analysis\n[What the data shows — connect back to hypothesis]\n\n### Decision\n[What was decided based on the results]\n\n### Learnings\n[What was learned beyond the hypothesis — surprises, side findings]\n\n## Next Steps\n\n**Recommended:** [recommended next step] — [one-line reason grounded in this artifact]\n\nOther options:\n- [conditional items from step 6 — only include items whose conditions are met]\n```\n\nCreate the `research\u002Fexperiments\u002F` directory if it doesn't exist.\n\n## Task Classification\n\nWhen this skill produces follow-up work, file it by execution semantics:\n\n- Immediately actionable implementation or documentation work goes in `tasks\u002Ftodo.md`.\n- Human-only external actions tied to automated steps go in `tasks\u002Fmanual-todo.md` with `_(blocks: Step N.X)_` or `_(after: Step N.X)_`; repo edits, SDK wiring, generated assets, local commands, tests, audits, and authenticated CLI\u002FAPI work stay in `tasks\u002Ftodo.md`.\n- One-time condition-gated records, baselines, or future measurements go in `tasks\u002Frecord-todo.md` with source, condition, non-blocking reason, evidence, and promotion rule.\n- Cadence-based reviews, playtests, adoption checks, investor updates, retros, or docs-health checks go in `tasks\u002Frecurring-todo.md` with cadence, owner\u002Fagent, next due, evidence path, and escalation conditions.\n- Do not put non-blocking records or recurring obligations in `tasks\u002Ftodo.md` unless they have been explicitly promoted into current execution work.\n\n## Constraints\n\n- **One hypothesis per experiment.** If the user has multiple things to test, design separate experiments. Don't bundle.\n- **Cheap and fast.** Every experiment should be completable in 1-4 weeks with minimal budget. If the design is expensive or slow, simplify.\n- **Specific success criteria.** \"Users like it\" is not a success criterion. \"≥40% of landing page visitors click 'Get Early Access'\" is.\n- **Present before writing.** Never write output files until the experiment design has been presented and validated.\n- **Include decision rules.** Every experiment must specify what happens for each possible outcome. No experiment should end with \"we'll figure it out.\"\n- **Reference benchmarks.** Success thresholds should be grounded in industry benchmarks or competitor data, not arbitrary numbers.\n- **Don't overdesign.** A simple survey can validate an assumption just as well as an elaborate A\u002FB test. Recommend the simplest method that produces a clear signal.\n\n## Alignment Page\n\nWhen this skill produces durable deliverables (research, specs, plans, reports, prototypes, or any document output), build a full-depth HTML alignment page following `ALIGNMENT-PAGE.md` in this skill's directory. Output: `alignment\u002Fexperiment-{topic}.html`.\n\n## Default Shipping Contract\n\nFollow the shared shipping contract convention in CLAUDE.md.\n","## Pack Availability Guard\n\nBefore telling the user to run a skill from another project-local pack, check `.agents\u002Fproject.json.enabled_packs`. If the target pack is not enabled, recommend `$pack install \u003Cpack>` instead of the target skill. Global skills are always valid. Skills from this same pack are valid because the current skill is already running from that pack.\n\n# Experiment — Lean Validation Design\n\nTakes a hypothesis (from `$assumption-tracker` or user) and designs a cheap, fast validation experiment. Covers landing page tests, fake-door tests, concierge MVPs, surveys, A\u002FB tests, pricing tests, and smoke tests. Outputs a structured plan with hypothesis, method, success criteria, sample size, timeline, and decision rules.\n\n## Soft Prerequisites\n\n- Read `research\u002Fassumption-tracker.md` if it exists — pulls the highest-priority unvalidated assumption\n- Read `research\u002Ficp.md` if it exists — grounds experiment design in who the target is\n- Read `research\u002Fmetrics.md` if it exists — aligns success criteria with existing metric definitions\n- Read `research\u002Fgtm.md` if it exists — leverages channel strategy for reaching test subjects\n\n## Process\n\n### 0. Product-Path Scope Resolution\n\nResolve research scope by product path before using code or app structure as a hint:\n\n1. If `$ARGUMENTS` names a non-archived `research\u002F{slug}\u002F` directory or a product-path ID whose `scope_path` points there, use that path. Treat `{slug}` as the product\u002Fapp name, not the ICP, audience, or segment label.\n2. If `$ARGUMENTS` names only `research\u002F_archive\u002F{slug}\u002F` or a manifest entry with `status: archived` or legacy `status: abandoned`, stop and warn that the path is archived; do not write or update scoped outputs there.\n3. Read `research\u002F.progress.yaml` when present. Normalize legacy `active_path` to `active_paths` on read and write back `active_paths` on manifest updates. Treat legacy `abandoned` as `archived`; exclude `archived`, `abandoned`, `deferred`, `revisit_candidate`, `promoted`, and any `scope_path` under `research\u002F_archive\u002F` from active target selection.\n4. If active product paths exist in the manifest, use those paths. If multiple active paths exist, ask which one to target unless this skill explicitly supports cross-path output.\n5. If no active manifest target exists, list non-archived product directories under `research\u002F`, excluding `research\u002F_archive\u002F` and dot directories. Auto-select only when exactly one exists; ask when multiple exist.\n6. If no product directories exist, use flat `research\u002F` single-product mode.\n7. Detect monorepo\u002Fapp\u002Fpackage structure only as a secondary hint. Suggest creating a missing `research\u002F{slug}\u002F` product path when code clearly exposes an app, but do not require code or monorepo detection before using `research\u002F{slug}\u002F`.\n\nWhen product path `{slug}` is active, read and write research under `research\u002F{slug}\u002F`, specs under `specs\u002F{slug}\u002F`, and treat top-level `research\u002F*.md` files as flat-mode documents or cross-path summaries.\n\n### 1. Product Path Manifest\n\nRead `research\u002F.progress.yaml` when present. Normalize `active_path` (singular legacy) to `active_paths` (plural list) when reading; treat legacy `abandoned` as `archived` and exclude archived\u002Fdeferred\u002Frevisit\u002Fpromoted paths plus `research\u002F_archive\u002F` scopes from active target selection. Scope experiment design to the active product path by default. When experiment results validate or invalidate assumptions about a deferred product path, add a `## Product Path Implications` section recommending `$product-line activate` or `$product-line archive` as appropriate.\n\n### 2. Parse Input & Load Context\n\n**Read `$ARGUMENTS`:**\n- If it's a specific hypothesis or assumption: use it directly\n- If it's a reference to an assumption number (e.g., \"#3\"): look it up in `research\u002Fassumption-tracker.md`\n- If empty: check `research\u002Fassumption-tracker.md` for the highest-priority unvalidated assumption. If no tracker exists, ask the user what they want to test. If the session is already in Plan mode and there are 2-3 concrete choices, prefer `request_user_input`.\n\n**Load context:** Read available research docs to understand the ICP, channels, metrics, and existing knowledge.\n\n### 3. Structure the Hypothesis\n\nConvert the input into a structured hypothesis:\n\n**Format**: \"We believe that [target segment] will [expected behavior] because [rationale]. We'll know this is true when [measurable outcome].\"\n\nPresent and refine with the user. If the session is already in Plan mode and there are 2-3 concrete choices, prefer `request_user_input`; otherwise ask in plain text:\n- \"Here's how I've structured the hypothesis. Does this capture what you want to test?\"\n- If the hypothesis is too broad, help narrow it to something testable in 1-2 weeks\n\n### 4. Research Experiment Methods\n\nUse WebSearch with **3-5 targeted queries** to find best practices for this type of validation:\n\n1. **Method-specific** — \"[experiment type] validation method\", \"how to test [hypothesis type]\"\n2. **Sample size** — \"[experiment type] sample size calculator\", \"minimum viable test size\"\n3. **Benchmarks** — \"[category] conversion rate benchmark\", \"[experiment type] typical results\"\n4. **Tools** — \"[experiment type] tools\", \"cheapest way to test [hypothesis]\"\n\n### 5. Design the Experiment — Present & Validate\n\nSelect the most appropriate experiment type and design the full plan:\n\n#### Experiment Types\n\n| Type | Best For | Timeline | Cost |\n|------|----------|----------|------|\n| **Landing page test** | Demand validation, messaging | 1-2 weeks | $50-200 (ads) |\n| **Fake-door test** | Feature demand, willingness to explore | 1 week | $0 (in-product) |\n| **Concierge MVP** | Value delivery, willingness to pay | 2-4 weeks | Time only |\n| **Survey** | Broad sentiment, preference ranking | 3-5 days | $0-100 |\n| **A\u002FB test** | Optimization, messaging variants | 1-2 weeks | $0 (in-product) |\n| **Pricing test** | Willingness to pay, price sensitivity | 1-2 weeks | $50-200 |\n| **Smoke test** | Demand for non-existent feature | 3-5 days | $0-50 |\n| **Pre-sale \u002F LOI** | B2B willingness to pay | 1-2 weeks | Time only |\n| **Wizard of Oz** | Complex feature viability | 2-4 weeks | Time only |\n\n**Present the experiment design to the user.** If the session is already in Plan mode, prefer `request_user_input`; otherwise ask in plain text. Show:\n- Recommended experiment type with rationale (why this method over alternatives)\n- Detailed plan with timeline and cost estimate\n- Success criteria with specific numbers (citing benchmarks from research)\n- Decision rules for both outcomes\n\nAsk:\n- \"Does this experiment design feel feasible? Too ambitious or too simple?\"\n- \"Any resource constraints I should know about? (budget, time, access to users)\"\n\nIncorporate feedback before proceeding.\n\n### 6. Define Decision Rules\n\nFor each possible outcome, define what happens next:\n\n- **If hypothesis is validated** (success criteria met): What's the next step? (e.g., build the feature, commit to the pricing, double down on the channel)\n- **If hypothesis is invalidated** (criteria not met): What's the pivot? (e.g., test alternative, revisit ICP, change approach)\n- **If results are inconclusive** (between thresholds): What additional data is needed? Run a follow-up experiment or extend the current one?\n\n### 7. Populate Next Steps\n\nInclude a **Recommended** item for the current design-stage next step, followed by **Other options**. Separate current next steps from outcome-specific next steps:\n\nUse this format in the output:\n\n```markdown\n## Next Steps\n\n**Recommended:** Run the experiment — the plan is only useful after the evidence is collected\n\nOther options:\n- [2-4 applicable alternatives]\n```\n\n- ALWAYS: Run the experiment (manual step — the plan tells you how)\n- For a newly designed experiment, do not list validation\u002Finvalidation commands as current top-level next steps; put those under `## Decision Rules` because they are only valid after results exist.\n- In `### If Validated`: include the next valid command, usually `$customer-feedback [results]` to log evidence, `$assumption-tracker` to mark the assumption validated, or `$roadmap` if the result commits the team to build.\n- In `### If Invalidated`: include `$assumption-tracker` to mark the assumption invalidated, plus `$brainstorm`, `$customer-discovery`, `$gtm`, or `$monetization` only when the failed assumption belongs to that domain.\n- In `### If Inconclusive`: include `$experiment [follow-up]` if the test needs another run, or `$customer-feedback` if qualitative evidence is the missing signal.\n- IF more assumptions remain untested after this design: `$experiment [next assumption]` — Design the next experiment\n- IF enough assumptions are validated after completed results: `$research-roadmap` — Check if research docs need updating based on learnings\n\n### 8. Write Output\n\nPresent final plan to user. Ask:\n- \"Ready to write this experiment plan? Anything to adjust?\"\n\nOnly after confirmation, write the output file.\n\n## Output\n\n### `research\u002Fexperiments\u002F[experiment-name].md` (or `research\u002F{slug}\u002Fexperiments\u002F[experiment-name].md`)\n\n```markdown\n# Experiment: [Descriptive Name]\n\n> Date designed: [current date]\n> Status: Designed | Running | Completed\n> Assumption: [from assumption-tracker, if applicable — include # reference]\n> Priority: [from assumption-tracker score, if applicable]\n\n## Hypothesis\n\n**We believe that** [target segment]\n**will** [expected behavior]\n**because** [rationale from research]\n\n**We'll know this is true when** [measurable outcome with specific threshold]\n\n## Method\n\n**Type**: [Landing page test \u002F Fake-door \u002F Concierge MVP \u002F Survey \u002F A\u002FB test \u002F Pricing test \u002F Smoke test \u002F Pre-sale \u002F Wizard of Oz]\n**Why this method**: [rationale — why this is the cheapest\u002Ffastest way to test this hypothesis]\n\n### Setup\n[Step-by-step instructions for setting up the experiment]\n\n1. [Step 1]\n2. [Step 2]\n3. ...\n\n### Tools Needed\n- [Tool 1] — [purpose]\n- [Tool 2] — [purpose]\n\n### Audience\n**Who**: [specific segment from ICP]\n**How to reach them**: [channel — from GTM if available]\n**Sample size**: [number needed for statistical significance]\n**Recruitment method**: [how to get participants]\n\n## Success Criteria\n\n| Metric | Failure | Inconclusive | Success |\n|--------|---------|--------------|---------|\n| [Primary metric] | \u003C [threshold] | [range] | ≥ [threshold] |\n| [Secondary metric] | \u003C [threshold] | [range] | ≥ [threshold] |\n\n**Benchmarks**: [what industry\u002Fcompetitor data says is typical]\n\n## Timeline\n\n| Phase | Duration | Tasks |\n|-------|----------|-------|\n| Setup | [days] | [what to prepare] |\n| Run | [days] | [data collection period] |\n| Analyze | [days] | [how to analyze results] |\n| **Total** | **[days]** | |\n\n## Budget\n\n| Item | Cost |\n|------|------|\n| [item] | [amount] |\n| **Total** | **[amount]** |\n\n## Decision Rules\n\n### If Validated (success criteria met)\n[Specific next actions — what to build, commit to, or double down on]\n\n### If Invalidated (failure criteria met)\n[Specific pivot — what to change, test next, or abandon]\n\n### If Inconclusive\n[What additional data is needed, whether to extend or redesign]\n\n## Results\n\n> Fill this section after the experiment completes.\n\n**Status**: [Validated \u002F Invalidated \u002F Inconclusive]\n**Date completed**: [date]\n\n### Raw Data\n[Key numbers and observations]\n\n### Analysis\n[What the data shows — connect back to hypothesis]\n\n### Decision\n[What was decided based on the results]\n\n### Learnings\n[What was learned beyond the hypothesis — surprises, side findings]\n\n## Next Steps\n\n**Recommended:** [recommended next step] — [one-line reason grounded in this artifact]\n\nOther options:\n- [conditional items from step 6 — only include items whose conditions are met]\n```\n\nCreate the `research\u002Fexperiments\u002F` directory if it doesn't exist.\n\n## Task Classification\n\nWhen this skill produces follow-up work, file it by execution semantics:\n\n- Immediately actionable implementation or documentation work goes in `tasks\u002Ftodo.md`.\n- Human-only external actions tied to automated steps go in `tasks\u002Fmanual-todo.md` with `_(blocks: Step N.X)_` or `_(after: Step N.X)_`; repo edits, SDK wiring, generated assets, local commands, tests, audits, and authenticated CLI\u002FAPI work stay in `tasks\u002Ftodo.md`.\n- One-time condition-gated records, baselines, or future measurements go in `tasks\u002Frecord-todo.md` with source, condition, non-blocking reason, evidence, and promotion rule.\n- Cadence-based reviews, playtests, adoption checks, investor updates, retros, or docs-health checks go in `tasks\u002Frecurring-todo.md` with cadence, owner\u002Fagent, next due, evidence path, and escalation conditions.\n- Do not put non-blocking records or recurring obligations in `tasks\u002Ftodo.md` unless they have been explicitly promoted into current execution work.\n\n## Constraints\n\n- **One hypothesis per experiment.** If the user has multiple things to test, design separate experiments. Don't bundle.\n- **Cheap and fast.** Every experiment should be completable in 1-4 weeks with minimal budget. If the design is expensive or slow, simplify.\n- **Specific success criteria.** \"Users like it\" is not a success criterion. \"≥40% of landing page visitors click 'Get Early Access'\" is.\n- **Present before writing.** Never write output files until the experiment design has been presented and validated.\n- **Include decision rules.** Every experiment must specify what happens for each possible outcome. No experiment should end with \"we'll figure it out.\"\n- **Reference benchmarks.** Success thresholds should be grounded in industry benchmarks or competitor data, not arbitrary numbers.\n- **Don't overdesign.** A simple survey can validate an assumption just as well as an elaborate A\u002FB test. Recommend the simplest method that produces a clear signal.\n\n## Alignment Page\n\nWhen this skill produces durable deliverables (research, specs, plans, reports, prototypes, or any document output), build a full-depth HTML alignment page following `ALIGNMENT-PAGE.md` in this skill's directory. Output: `alignment\u002Fexperiment-{topic}.html`.\n\n## Default Shipping Contract\n\nFollow the shared shipping contract convention in CLAUDE.md.\n",{"name":42,"type":43,"version":44,"description":45,"argument-hint":46,"interview_depth":47},"experiment","planning","v0.4","Design lean validation experiments — hypothesis, method, success criteria, sample size, timeline, and decision rules","\u003Chypothesis or assumption to test>","light","master","96e2912af886dd1606b1b97df707715aef062b02",".claude-plugin\u002Fskills\u002Fobservability",230,"https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton","https:\u002F\u002Fhamilton.apache.org\u002F","https:\u002F\u002Fgithub.com\u002Fapache","https:\u002F\u002Fwww.apache.org\u002F","2026-11-14 13:21:06",{"source":8,"skillName":42,"commands":58,"prompt":68,"zipAvailable":69},[59,62,65],{"tool":60,"command":61},"npx","npx skills add apache\u002Fhamilton --skill experiment",{"tool":63,"command":64},"bunx","bunx skills add apache\u002Fhamilton --skill experiment",{"tool":66,"command":67},"pnpm","pnpm dlx skills add apache\u002Fhamilton --skill experiment","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton\u002Fblob\u002Fmain\u002F.claude-plugin\u002Fskills\u002Fobservability\u002FSKILL.md",true,[],[72,97,121,142,160,180],{"skillNo":73,"name":74,"nameZh":6,"description":75,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":76,"categories":77,"keywords":83,"publishedAt":37},"01M6ACKMNJ1SZJESEPW7MABKW9","hamilton-scale","Performance and parallelization patterns for Hamilton including async I\u002FO, Spark, Ray, Dask, caching, and multithreading. Use for scaling Hamilton workflows.","https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton\u002Fblob\u002Fmain\u002F.claude-plugin\u002Fskills\u002Fscale\u002FSKILL.md",[78],{"categoryNo":79,"categoryName":80,"taxonomyType":81,"taxonomyTypeDesc":82},"01JBSEEDCAT000000000000013","分析与可视化","SCENARIO","使用场景",[84,85,30,86,87,88,89,90,21,91,28,26,92,93,25,94,95,24,23,22,96],"hamilton scale","scale","performance","workflows","spark","Ray","dask","parallelization","async","pytest","caching","scaling","multithreading",{"skillNo":98,"name":99,"nameZh":6,"description":100,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":101,"categories":102,"keywords":106,"publishedAt":37},"01M6ACKEWF1TGHNCVPTJ9HQTDQ","hamilton-mcp","Interactive Hamilton DAG development via MCP tools. Validate, visualize, scaffold, and execute Hamilton pipelines without leaving the conversation. Use when building or debugging Hamilton dataflows interactively.","https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton\u002Fblob\u002Fmain\u002F.claude-plugin\u002Fskills\u002Fmcp\u002FSKILL.md",[103],{"categoryNo":104,"categoryName":105,"taxonomyType":81,"taxonomyTypeDesc":82},"01JBSEEDCAT000000000000023","Skill与智能体开发",[107,108,30,109,110,111,112,35,113,114,115,21,29,28,116,26,117,24,118,23,119,120],"MCP","hamilton mcp","visualize","dag","validate","scaffold","development","mcp tools","Tools","interactive","conversation","via","pip","when",{"skillNo":122,"name":123,"nameZh":6,"description":124,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":125,"categories":126,"keywords":129,"publishedAt":37},"01M6ACKC8346RJXKRZE4KJRT3X","hamilton-llm","LLM and AI workflow patterns for Hamilton including RAG pipelines, embeddings, vector databases, and prompt engineering. Use for building AI applications with Hamilton.","https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton\u002Fblob\u002Fmain\u002F.claude-plugin\u002Fskills\u002Fllm\u002FSKILL.md",[127,128],{"categoryNo":79,"categoryName":80,"taxonomyType":81,"taxonomyTypeDesc":82},{"categoryNo":104,"categoryName":105,"taxonomyType":81,"taxonomyTypeDesc":82},[130,30,131,132,133,134,135,136,21,137,28,26,138,93,139,25,140,141,24,23,22],"hamilton llm","prompt engineering","workflow","rag","vector","embeddings","applications","prompt","databases","workflow patterns","AI workflow","vector databases",{"skillNo":143,"name":144,"nameZh":6,"description":145,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":146,"categories":147,"keywords":149,"publishedAt":37},"01M6ACK9F2H02P3P93FAF464DQ","hamilton-integrations","Hamilton integration patterns for Airflow, Dagster, FastAPI, Streamlit, Jupyter notebooks, and other frameworks. Use when integrating Hamilton with other tools.","https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton\u002Fblob\u002Fmain\u002F.claude-plugin\u002Fskills\u002Fintegrations\u002FSKILL.md",[148],{"categoryNo":79,"categoryName":80,"taxonomyType":81,"taxonomyTypeDesc":82},[150,151,30,152,153,154,115,21,29,28,155,156,26,25,157,24,158,159,23,22,120],"hamilton integrations","integrations","airflow","jupyter notebooks","integration","jupyter","fastapi","frameworks","dagster","with",{"skillNo":161,"name":162,"nameZh":6,"description":163,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":164,"categories":165,"keywords":167,"publishedAt":37},"01M6ACK6JDEDAR8QMCHKJ7MD08","hamilton-dev-workflow","Systematic 5-step workflow for building Hamilton DAGs - DOT graphs, signatures, validation, TDD implementation. Use this workflow when creating new Hamilton modules from scratch.","https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton\u002Fblob\u002Fmain\u002F.claude-plugin\u002Fskills\u002Fhamilton-dev-workflow\u002FSKILL.md",[166],{"categoryNo":104,"categoryName":105,"taxonomyType":81,"taxonomyTypeDesc":82},[132,168,169,170,30,171,172,21,28,26,173,174,93,175,176,24,177,23,22,178,120,179],"dev","hamilton dev workflow","dev workflow","tdd","validation","dot","modules","signatures","systematic","From Scratch","scratch","new",{"skillNo":181,"name":182,"nameZh":6,"description":183,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":184,"categories":185,"keywords":190,"publishedAt":37},"01M6ACK3D2QMS55YDKB6QEMSQC","hamilton-core","Core Hamilton patterns for creating DAGs, applying decorators, testing, and debugging dataflows. Use for basic Hamilton development tasks.","https:\u002F\u002Fgithub.com\u002Fapache\u002Fhamilton\u002Fblob\u002Fmain\u002F.claude-plugin\u002Fskills\u002Fcore\u002FSKILL.md",[186,189],{"categoryNo":187,"categoryName":188,"taxonomyType":81,"taxonomyTypeDesc":82},"01JBSEEDCAT000000000000008","测试与质量",{"categoryNo":79,"categoryName":80,"taxonomyType":81,"taxonomyTypeDesc":82},[191,192,193,30,35,194,113,21,29,28,26,93,25,195,24,196,23,22],"core","hamilton core","testing","tasks","basic","decorators"]