inclusive-experiment-analysis
Evaluate A/B tests for inclusive product impact across user groups, accessibility needs, device constraints, privacy behavior, bandwidth, geography, and underrepresented segments. Use when checking whether an experiment benefits or harms different user groups, planning segmentation dimensions, auditing test/control balance, interpreting subgroup effects, or reviewing product changes for inclusive experimentation.
- License 许可
- MIT
- 最近更新
- 2026-11-14
- Stars
- ★ 1.6k
- Forks
- 491
01 前言 Front Matter
- name
- inclusive-experiment-analysis
- license
- MIT
- metadata
- { "tags": "practical-ab-testing,ab-testing,experimentation,inclusive-design,product-analytics", "version": "0.1.0", "category": "Product Management", "displayName": "Inclusive Experiment Analysis" }
- description
- Evaluate A/B tests for inclusive product impact across user groups, accessibility needs, device constraints, privacy behavior, bandwidth, geography, and underrepresented segments. Use when checking whether an experiment benefits or harms different user groups, planning segmentation dimensions, auditing test/control balance, interpreting subgroup effects, or reviewing product changes for inclusive experimentation.
- compatibility
- Codex, Claude Code, and other Agent Skills-compatible clients.
02 资源文件 5
- 参考文档guidelines.md1.3 KB
- 参考文档references/core/examples.md1.4 KB
- 参考文档references/core/knowledge.md2.0 KB
- 参考文档references/core/rules.md1.6 KB
- 参考文档workflows/review-inclusive-impact.md2.1 KB
03 SKILL.md 正文
Inclusive Experiment Analysis
Use this skill to make sure experiment design and readouts consider the range of users affected by a product change. It focuses on subgroup impact, accessibility, representation, data dimensions, and unintended harm.
Source Traceability
Primary source: Practical A/B Testing by Leemay Nassery. Guidance is transformed and paraphrased from chapter 1 lines 719-912 and related subgroup analysis context from lines 639-718. Metric and eligibility context comes from chapter 2 lines 1564-1735.
Related Advanced Skills
trustworthy-experiment-insights: use when subgroup findings may be underpowered, false positives, or false negatives.experiment-verification-monitoring: use when inclusion risks depend on assignment, exposure, device, geography, accessibility, or segment monitoring.adaptive-experimentation-strategy: use cautiously when contextual bandits or personalization could create uneven user impact across groups.
Reference Routing
| Need | Read |
|---|---|
| Inclusive experiment concepts | references/core/knowledge.md |
| Design and analysis rules | references/core/rules.md |
| Segment examples | references/core/examples.md |
| Review workflow | workflows/review-inclusive-impact.md |
Workflow
- Identify which user groups could experience the change differently.
- Choose dimensions that are relevant, ethical, and available.
- Check test/control balance for important dimensions when possible.
- Include accessibility, bandwidth, device, privacy, geography, and usage-level concerns where relevant.
- Analyze subgroup outcomes without cherry-picking.
- Recommend launch, mitigation, follow-up testing, or deeper research.
Output Format
# Inclusive Experiment Review
## Change Under Review
[What is changing and who may be affected.]
## User Dimensions
| Dimension | Why It Matters | Data Available? | Use In Analysis? |
|-----------|----------------|-----------------|------------------|
## Balance And Impact
| Segment | Control | Test | Result | Concern |
|---------|---------|------|--------|---------|
## Risks
- Accessibility:
- Device or bandwidth:
- Privacy or consent:
- Representation:
- Data limitations:
## Recommendation
[Ship | Ship with mitigation | Do not ship | Investigate] because [reason].
Quality Bar
- Do not use sensitive attributes casually; explain why a dimension is needed.
- Do not claim inclusive impact when the data lacks relevant representation.
- Do not average away harm to a meaningful subgroup.
- Pair quantitative subgroup analysis with qualitative or accessibility review when metrics cannot capture the risk.
04 同仓库更多 Skills
worktable-review-with-annotations
Create, inspect, reply to, update, or resolve situated Worktable annotations. Use when feedback belongs to a Doc section, block, text range, or HTML Doc, or when the user asks to address existing review feedback and coordinate a requested artifact edit.
worktable-find-and-synthesize-context
Find, assess, and synthesize context from Worktable Docs and Records. Use when the user asks what a workspace contains, wants workspace-backed research, needs current facts reconciled across artifacts, or requests a cited synthesis without changing workspace state.
worktable-create-or-update-docs
Create, edit, rename, or maintain narrative Worktable Docs. Use for plans, decisions, briefs, notes, research syntheses, and other durable prose when the user requests a new artifact or a safe update to an existing one.
worktable-create-or-manage-records
Organize repeated structured information as durable Worktable Records. Use for research datasets, inventories, directories, pipelines, trackers, and other collections whose items need identity, fields, filtering, links, validation, or individual updates.
worktable-create-or-manage-interactive-html
Create or improve durable visual and interactive artifacts in Worktable. Use for dashboards, trackers, calculators, mini apps, slide presentations, and other requests that benefit from a polished HTML Doc.
worktable-collaborate-threads
Read, answer, and hand off messages through durable Worktable threads with users or other authenticated participants. Use when the user asks to check addressed messages, reply to a participant, continue a thread, request another agent's help, wait briefly for a response, or watch for comments and messages sent to the agent.