Illustration of a short bar and a tall bar with an arrow showing the gap between current and target results

Gap Analysis in Optimizely Web Experimentation

First published in October 2023. Restored in October 2026, with notes on anything that has changed since.

How to perform Gap Analysis in Optimizely Web Experimentation

How to Conduct Gap Analysis

In the context of Optimizely Web Experimentation, “Gap Analysis” refers to the process of identifying discrepancies or gaps between the current state or performance of a webpage or digital experience and the desired state or performance. Gap Analysis is a crucial exercise in the optimisation process and involves the following key steps:

Assess the Current Outcomes

This involves a comprehensive evaluation of the existing webpage or digital experience. Metrics and data are collected to understand how the current version is performing, including user engagement, conversion rates, bounce rates, and other relevant key performance indicators (KPIs). For example you may find that your e-commerce site has an average conversion rate of 5%.

Define the Desired Outcomes

In this phase, you establish clear goals and objectives for what you want to achieve through optimisation. This could include improving conversion rates, reducing bounce rates, increasing user engagement, or achieving specific business outcomes. E.g. after researching you discover that the industry standard conversion rate is 7%, this becomes your target rate.

Identify the Gap

Gap Analysis involves comparing the current state data with the desired state goals. It identifies where discrepancies or gaps exist between the two. These gaps highlight areas that need improvement or optimisation to align with the desired objectives. From above you know that the you want to increase the conversion rate by an absolute rate of 2%, or a 40% relative increase (5% to 7%).

Develop Your Hypotheses

Once the gaps are identified, you formulate hypotheses about what changes or variations could bridge these gaps and improve the performance of the webpage or digital experience. These hypotheses serve as the basis for experimentation.

Experiment and Test

With hypotheses in place, you design and conduct experiments using Optimizely Web Experimentation, through the various types of experiments that can be performed, from standard A/B tests to Multi-Arm Bandit for time critical campaigns. These experiments involve implementing changes or variations to the webpage and measuring the impact on key metrics, in this case Conversion Rate.

Analyse the Data

After running experiments, data is collected and analysed to determine whether the proposed changes have closed the gaps and brought the performance closer to the desired state. Within the experiments results screen, review Statistical Significance alongside Confidence Intervals to validate the results. Use this to determine which changes have impacted the move towards the desired Conversion Rate.

Optimise and Iterate Through Gap Analysis

Based on the analysis, successful changes may be implemented permanently, while unsuccessful ones are refined or abandoned. Gap Analysis is an iterative process, and the cycle continues until the desired state is achieved. Based on your results, review and update your experimentation roadmap to take into account the lessons learned.

Gap Analysis in Optimizely Web Experimentation (opens in a new tab) is a systematic approach to identify, prioritise, and address performance gaps on webpages or digital experiences. It ensures that optimisation efforts are data-driven, goal-oriented, and result in continuous improvements aligned with organisational objectives.

Frequently Asked Questions

What is gap analysis in Optimizely Web Experimentation?

Gap analysis is a way to find the difference between how a page or digital experience performs today and how you want it to perform. You measure the current outcomes, set a target, identify the gap, then run experiments in Optimizely Web Experimentation to close it.

What are the steps in a gap analysis?

There are seven:

  1. Assess the current outcomes.
  2. Define the desired outcomes.
  3. Identify the gap.
  4. Develop hypotheses.
  5. Experiment and test.
  6. Analyse the data.
  7. Optimise and iterate.

How do you measure the gap?

Compare your current results with your target. For example, if your conversion rate is 5% and the industry standard is 7%, the gap is 2 percentage points, or a 40% relative increase.

Which experiments can help close the gap?

Optimizely Web Experimentation supports several types, from standard A/B tests to multi-armed bandits for time-critical campaigns. Each tests a hypothesis about what could close the gap.

How do you know whether a change closed the gap?

On the experiment results page, review statistical significance alongside confidence intervals. Implement the changes that worked, refine or drop the ones that didn't, and update your experimentation roadmap.