[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6MC6Q0M1T7SH60Z2FCEAZPR":3,"skill-same:01M6MC6Q0M1T7SH60Z2FCEAZPR":105},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":26,"publishedAt":48,"linkOnly":49,"markdownContent":50,"markdownBody":51,"frontMatter":52,"refName":59,"commitSha":60,"skillDirectory":61,"forksCount":62,"repositoryHtmlUrl":63,"repositoryHomepageUrl":64,"ownerHtmlUrl":65,"ownerBlogUrl":66,"ownerDescription":67,"updatedAt":68,"install":69,"resources":82},"01M6MC6Q0M1T7SH60Z2FCEAZPR","experiment-sensitivity-optimization",null,"Improve experiment sensitivity and reduce traffic or duration requirements. Use when choosing sensitive metrics, working with minimum detectable effect, reducing variants, applying capping metrics, CUPED, variance reduction, or deciding how to get trustworthy A\u002FB test signal with fewer users.","hashgraph-online\u002Fawesome-codex-plugins","hashgraph-online","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F160371962?v=4","01M6CNB6NRJVNNGN14TR01Q6D3","HOL (Hashgraph Online)","01M6JT1HSKKG9V68KQAQGBA7XP",1575,"MIT","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002FLVTD-LLC\u002Fskills\u002Fskills\u002Fexperiment-sensitivity-optimization\u002FSKILL.md",[18,23],{"categoryNo":19,"categoryName":20,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000008","测试与质量","SCENARIO","使用场景",{"categoryNo":24,"categoryName":25,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000023","Skill与智能体开发",[27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],"experiment sensitivity optimization","Optimization","experiment","sensitivity","when","testing","variants","reduce","traffic","ab-testing","experimentation","how to","ab","get","next","practical","effect","improve","how","product","code","2026-11-10 10:12:30",false,"---\nname: experiment-sensitivity-optimization\ndescription: Improve experiment sensitivity and reduce traffic or duration requirements. Use when choosing sensitive metrics, working with minimum detectable effect, reducing variants, applying capping metrics, CUPED, variance reduction, or deciding how to get trustworthy A\u002FB test signal with fewer users.\nlicense: MIT\ncompatibility: Codex, Claude Code, and other Agent Skills-compatible clients.\nmetadata:\n  version: \"0.1.0\"\n  displayName: Experiment Sensitivity Optimization\n  category: Product Management\n  tags: practical-ab-testing,next-level-ab-testing,ab-testing,experimentation,metrics\n---\n\n# Experiment Sensitivity Optimization\n\nUse this skill to redesign an experiment so it can detect meaningful effects\nwith fewer users, less time, or clearer metrics. It focuses on minimum\ndetectable effect, metric sensitivity, capping, variant reduction, CUPED, and\nvariance reduction.\n\n## Source Traceability\n\nPrimary source: *Next-Level A\u002FB Testing* by Leemay Nassery. Guidance is\ntransformed and paraphrased from Chapter 3 on experiment design, sensitive\nmetrics, minimum detectable effect, capping, reducing variants, and CUPED; and\nChapter 6 on stratified random sampling and covariate adjustments.\n\nRelated skills:\n\n- `ab-test-design-brief` for baseline experiment specs.\n- `trustworthy-experiment-insights` for judging whether a result is believable.\n- `experimentation-throughput-strategy` for capacity and test scheduling.\n\n## Reference Routing\n\n| Need | Read |\n|------|------|\n| Sensitivity concepts | `references\u002Fcore\u002Fknowledge.md` |\n| Metric, variance, and sample-size rules | `references\u002Fcore\u002Frules.md` |\n| Optimization scenarios | `references\u002Fcore\u002Fexamples.md` |\n| Step-by-step sensitivity review | `workflows\u002Foptimize-experiment-sensitivity.md` |\n\n## Workflow\n\n1. State the decision and the smallest practically meaningful effect.\n2. Check whether the current primary metric is close enough to the feature's\n   mechanism.\n3. Reduce unnecessary variants and separate learning tests from launch tests.\n4. Consider metric capping, CUPED, stratification, or other variance reduction.\n5. Record data prerequisites, risks, and interpretation limits.\n6. Update the experiment brief with the revised measurement plan.\n\n## Output Format\n\n```markdown\n# Experiment Sensitivity Plan\n\n## Decision\n[What the experiment must decide.]\n\n## Current Constraint\n[Traffic | Duration | Noisy metric | Too many variants | Weak proxy | Other]\n\n## Recommended Changes\n| Change | Why It Helps | Requirement | Risk |\n|--------|--------------|-------------|------|\n\n## Metric Plan\n- Primary metric:\n- More sensitive alternative:\n- Guardrails:\n- Minimum detectable effect:\n\n## Variance Reduction\n- Technique:\n- Data needed:\n- Validation:\n\n## Interpretation Notes\n- What this design can conclude:\n- What it cannot conclude:\n```\n\n## Quality Bar\n\n- Do not optimize sensitivity by switching to a metric that no longer answers\n  the product decision.\n- Do not add CUPED, stratification, or capping unless the data requirements and\n  interpretation risks are named.\n- Do not keep extra variants when they are not needed for the decision.\n- Do not treat a smaller detectable effect as useful unless it is practically\n  meaningful.\n","# Experiment Sensitivity Optimization\n\nUse this skill to redesign an experiment so it can detect meaningful effects\nwith fewer users, less time, or clearer metrics. It focuses on minimum\ndetectable effect, metric sensitivity, capping, variant reduction, CUPED, and\nvariance reduction.\n\n## Source Traceability\n\nPrimary source: *Next-Level A\u002FB Testing* by Leemay Nassery. Guidance is\ntransformed and paraphrased from Chapter 3 on experiment design, sensitive\nmetrics, minimum detectable effect, capping, reducing variants, and CUPED; and\nChapter 6 on stratified random sampling and covariate adjustments.\n\nRelated skills:\n\n- `ab-test-design-brief` for baseline experiment specs.\n- `trustworthy-experiment-insights` for judging whether a result is believable.\n- `experimentation-throughput-strategy` for capacity and test scheduling.\n\n## Reference Routing\n\n| Need | Read |\n|------|------|\n| Sensitivity concepts | `references\u002Fcore\u002Fknowledge.md` |\n| Metric, variance, and sample-size rules | `references\u002Fcore\u002Frules.md` |\n| Optimization scenarios | `references\u002Fcore\u002Fexamples.md` |\n| Step-by-step sensitivity review | `workflows\u002Foptimize-experiment-sensitivity.md` |\n\n## Workflow\n\n1. State the decision and the smallest practically meaningful effect.\n2. Check whether the current primary metric is close enough to the feature's\n   mechanism.\n3. Reduce unnecessary variants and separate learning tests from launch tests.\n4. Consider metric capping, CUPED, stratification, or other variance reduction.\n5. Record data prerequisites, risks, and interpretation limits.\n6. Update the experiment brief with the revised measurement plan.\n\n## Output Format\n\n```markdown\n# Experiment Sensitivity Plan\n\n## Decision\n[What the experiment must decide.]\n\n## Current Constraint\n[Traffic | Duration | Noisy metric | Too many variants | Weak proxy | Other]\n\n## Recommended Changes\n| Change | Why It Helps | Requirement | Risk |\n|--------|--------------|-------------|------|\n\n## Metric Plan\n- Primary metric:\n- More sensitive alternative:\n- Guardrails:\n- Minimum detectable effect:\n\n## Variance Reduction\n- Technique:\n- Data needed:\n- Validation:\n\n## Interpretation Notes\n- What this design can conclude:\n- What it cannot conclude:\n```\n\n## Quality Bar\n\n- Do not optimize sensitivity by switching to a metric that no longer answers\n  the product decision.\n- Do not add CUPED, stratification, or capping unless the data requirements and\n  interpretation risks are named.\n- Do not keep extra variants when they are not needed for the decision.\n- Do not treat a smaller detectable effect as useful unless it is practically\n  meaningful.\n",{"name":5,"license":15,"metadata":53,"description":7,"compatibility":58},{"tags":54,"version":55,"category":56,"displayName":57},"practical-ab-testing,next-level-ab-testing,ab-testing,experimentation,metrics","0.1.0","Product Management","Experiment Sensitivity Optimization","Codex, Claude Code, and other Agent Skills-compatible clients.","main","2b63f856ce19c2a797929cacabd9e0fc936812fa","plugins\u002FLVTD-LLC\u002Fskills\u002Fskills\u002Fexperiment-sensitivity-optimization",491,"https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins","https:\u002F\u002Fhol.org\u002Fplugins\u002Fbest-codex-plugins","https:\u002F\u002Fgithub.com\u002Fhashgraph-online","https:\u002F\u002Fhol.org","Open-source standards and developer tools for interoperable AI agents: discovery, identity, communication, payments, privacy and security.","2026-11-14 14:06:13",{"source":8,"skillName":5,"commands":70,"prompt":80,"zipAvailable":81},[71,74,77],{"tool":72,"command":73},"npx","npx skills add hashgraph-online\u002Fawesome-codex-plugins --skill experiment-sensitivity-optimization",{"tool":75,"command":76},"bunx","bunx skills add hashgraph-online\u002Fawesome-codex-plugins --skill experiment-sensitivity-optimization",{"tool":78,"command":79},"pnpm","pnpm dlx skills add hashgraph-online\u002Fawesome-codex-plugins --skill experiment-sensitivity-optimization","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002FLVTD-LLC\u002Fskills\u002Fskills\u002Fexperiment-sensitivity-optimization\u002FSKILL.md",true,[83,89,93,97,101],{"path":84,"resourceType":85,"resourceTypeDesc":86,"sizeBytes":87,"sourceHtmlUrl":88},"guidelines.md","REFERENCE","参考文档",1735,"https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002FLVTD-LLC\u002Fskills\u002Fskills\u002Fexperiment-sensitivity-optimization\u002Fguidelines.md",{"path":90,"resourceType":85,"resourceTypeDesc":86,"sizeBytes":91,"sourceHtmlUrl":92},"references\u002Fcore\u002Fexamples.md",2542,"https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002FLVTD-LLC\u002Fskills\u002Fskills\u002Fexperiment-sensitivity-optimization\u002Freferences\u002Fcore\u002Fexamples.md",{"path":94,"resourceType":85,"resourceTypeDesc":86,"sizeBytes":95,"sourceHtmlUrl":96},"references\u002Fcore\u002Fknowledge.md",3332,"https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002FLVTD-LLC\u002Fskills\u002Fskills\u002Fexperiment-sensitivity-optimization\u002Freferences\u002Fcore\u002Fknowledge.md",{"path":98,"resourceType":85,"resourceTypeDesc":86,"sizeBytes":99,"sourceHtmlUrl":100},"references\u002Fcore\u002Frules.md",2931,"https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002FLVTD-LLC\u002Fskills\u002Fskills\u002Fexperiment-sensitivity-optimization\u002Freferences\u002Fcore\u002Frules.md",{"path":102,"resourceType":85,"resourceTypeDesc":86,"sizeBytes":103,"sourceHtmlUrl":104},"workflows\u002Foptimize-experiment-sensitivity.md",2604,"https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002FLVTD-LLC\u002Fskills\u002Fskills\u002Fexperiment-sensitivity-optimization\u002Fworkflows\u002Foptimize-experiment-sensitivity.md",[106,115,123,131,139,147],{"skillNo":107,"name":108,"nameZh":6,"description":109,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":110,"sourceHtmlUrl":111,"categories":112,"keywords":113,"publishedAt":114},"01M7DV332YQMGD8WTRJ9DZQXTB","worktable-review-with-annotations","Create, inspect, reply to, update, or resolve situated Worktable annotations. Use when feedback belongs to a Doc section, block, text range, or HTML Doc, or when the user asks to address existing review feedback and coordinate a requested artifact edit.","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-review-with-annotations\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-review-with-annotations\u002FSKILL.md",[],[],"2026-11-15 14:19:17",{"skillNo":116,"name":117,"nameZh":6,"description":118,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":119,"sourceHtmlUrl":120,"categories":121,"keywords":122,"publishedAt":114},"01M7DV2YGHCZVBEB1AHYB6CGHE","worktable-find-and-synthesize-context","Find, assess, and synthesize context from Worktable Docs and Records. Use when the user asks what a workspace contains, wants workspace-backed research, needs current facts reconciled across artifacts, or requests a cited synthesis without changing workspace state.","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-find-and-synthesize-context\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-find-and-synthesize-context\u002FSKILL.md",[],[],{"skillNo":124,"name":125,"nameZh":6,"description":126,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":127,"sourceHtmlUrl":128,"categories":129,"keywords":130,"publishedAt":114},"01M7DV2TQN1H11ME2SAF9MXN7V","worktable-create-or-update-docs","Create, edit, rename, or maintain narrative Worktable Docs. Use for plans, decisions, briefs, notes, research syntheses, and other durable prose when the user requests a new artifact or a safe update to an existing one.","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-create-or-update-docs\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-create-or-update-docs\u002FSKILL.md",[],[],{"skillNo":132,"name":133,"nameZh":6,"description":134,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":135,"sourceHtmlUrl":136,"categories":137,"keywords":138,"publishedAt":114},"01M7DV2NE452NEA8TXATKSNAJH","worktable-create-or-manage-records","Organize repeated structured information as durable Worktable Records. Use for research datasets, inventories, directories, pipelines, trackers, and other collections whose items need identity, fields, filtering, links, validation, or individual updates.","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-create-or-manage-records\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-create-or-manage-records\u002FSKILL.md",[],[],{"skillNo":140,"name":141,"nameZh":6,"description":142,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":143,"sourceHtmlUrl":144,"categories":145,"keywords":146,"publishedAt":114},"01M7DV2HENRBR2KSCVM064WH0Y","worktable-create-or-manage-interactive-html","Create or improve durable visual and interactive artifacts in Worktable. Use for dashboards, trackers, calculators, mini apps, slide presentations, and other requests that benefit from a polished HTML Doc.","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-create-or-manage-interactive-html\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-create-or-manage-interactive-html\u002FSKILL.md",[],[],{"skillNo":148,"name":149,"nameZh":6,"description":150,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":151,"sourceHtmlUrl":152,"categories":153,"keywords":154,"publishedAt":114},"01M7DV2CADR5R7RQFFYPNAGR9Y","worktable-collaborate-threads","Read, answer, and hand off messages through durable Worktable threads with users or other authenticated participants. Use when the user asks to check addressed messages, reply to a participant, continue a thread, request another agent's help, wait briefly for a response, or watch for comments and messages sent to the agent.","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-collaborate-threads\u002FLICENSE","https:\u002F\u002Fgithub.com\u002Fhashgraph-online\u002Fawesome-codex-plugins\u002Fblob\u002Fmain\u002Fplugins\u002Fworktable\u002Fworktable-plugin\u002Fskills\u002Fworktable-collaborate-threads\u002FSKILL.md",[],[]]