Ab Test Setup
Skill Verified ActiveWhen the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "conversion experiment," "statistical significance," or "test this." For tracking implementation, see analytics-tracking.
To guide users through the entire process of designing and executing statistically valid A/B tests for marketing and product optimization.
Features
- Structured A/B test design framework
- Hypothesis formulation guidance
- Sample size and duration calculation tool
- Metric selection criteria (primary, secondary, guardrail)
- Variant design best practices
- Templates for test plans and results documentation
Use Cases
- When planning a new A/B test for a website or feature
- When needing to determine the required sample size for an experiment
- When analyzing the results of an A/B test and deciding on next steps
- When establishing best practices for experimentation within a team
Non-Goals
- Implementing the A/B test tracking infrastructure (see analytics-tracking)
- Providing ideas for what to test (see page-cro)
- Automating the execution of A/B tests (focus is on design and analysis)
Installation
First, add the marketplace
/plugin marketplace add alirezarezvani/claude-skills/plugin install marketing-skill@claude-code-skillsQuality Score
VerifiedTrust Signals
Similar Extensions
Measure Experiment Design
100Designs an A/B test or experiment with clear hypothesis, variants, success metrics, sample size, and duration. Use when planning experiments to validate product changes or test hypotheses.
OraClaw Bandit
99A/B testing and feature optimization for AI agents. Pick the best option automatically using Multi-Armed Bandits and Contextual Bandits (LinUCB). No data warehouse needed — works from request
Experiment Designer
99Use when planning product experiments, writing testable hypotheses, estimating sample size, prioritizing tests, or interpreting A/B outcomes with practical statistical rigor.
Experiment Design
99A discipline for designing experiments (A/B tests, multivariate, holdouts) so the results actually answer the question you asked. Hypothesis writing, sample size, duration, segment analysis, interpretation, decision-making, and the common failure modes that produce confidently wrong shipping decisions.
Run Ab Test Models
95Design and execute A/B tests for ML models in production using traffic splitting, statistical significance testing, and canary/shadow deployment strategies. Measure performance differences and make data-driven decisions about model rollout. Use when validating a new model version before full rollout, comparing candidate models trained with different algorithms, measuring business metric impact of model changes, or when regulatory requirements mandate gradual rollout.
Survey Insect Population
100Design and execute insect population surveys covering survey design, sampling methods, field execution, specimen identification, diversity index calculation including Shannon-Wiener and Simpson indices, statistical analysis, and reporting. Covers defining survey objectives, selecting study sites, determining sampling intensity and replication, choosing sampling methods appropriate to target taxa, standardizing collection effort, recording environmental covariates, identifying specimens to the lowest practical taxonomic level, calculating species richness, Shannon-Wiener diversity (H'), Simpson diversity (1-D), evenness, rarefaction curves, multivariate ordination, and producing survey reports with species lists and conservation implications. Use when conducting baseline biodiversity assessments, monitoring insect populations over time, comparing insect communities across habitats or treatments, assessing environmental impact, or supporting conservation planning with quantitative ecological data.