Optimizely Experimentation makes it easy to A/B test your site. Use the Editor to design variations, define where the experiment runs and who sees it, set events to measure success, and test. When your experiment looks and works the way you want, publish it live to the world!
Follow the six steps in this topic to create, configure, and launch a new experiment in Optimizely Web Experimentation. See Optimizely Web Experimentation implementation checklist.
Optimizely Performance Edge is a lightweight experimentation product that delivers significantly faster performance than other versions of Optimizely. It does this by relying on a streamlined "microsnippet" which limits the range of available features.
If you are using Optimizely Performance Edge, some of the features mentioned in this article may not be available to you. Each section of this article contains links to other, more detailed articles on that section's topic. Click through to those articles for a clear delineation of which features are available for Edge experiments, and which are not.
Want to dig a little deeper? See Optimizely Academy course on how to build an experiment in Optimizely.
Begin by creating a new experiment. You will add URL targeting, variations, audiences, and metrics to your experiment in later steps.
-
Go to the Experiments dashboard.
-
Click Create New.
-
Select A/B Test from the dropdown.
-
Type a name and description for your new experiment.
Step 1. URL Targeting
Set where your experiment will run. You can choose where your experiment runs or you can use pages for this instead.
In general, if you want to add a simple URL to run an experiment just once, target the single URL. If, on the other hand, you plan to run experiments on this set of URLs regularly, you'll want to use pages.
In Optimizely Web Experimentation experiments, you can use a combination of page triggers and conditions to tell when to activate a page. These options are useful for single-page applications (SPAs). In Optimizely Performance Edge experiments, pages always activate immediately. See also set up a new page.
Before you can run an experiment, implement the snippet and create at least one page and metric in Optimizely Web Experimentation. If your account uses custom snippets, you might see more than one snippet listed. In this case, choose the snippet you want to use for your experiment.
Step 2. Create a variation
From the Experiments dashboard, click the experiment name to open the experiment. To make changes to your variations. Select the variation you want to edit.
In the Visual Editor, you can make any changes to the layout and appearance of your site, including:
-
Change the layout, including the element's visibility or position; or even rearrange the element on the page
-
Modify or replace typography, images, background styles or borders
-
Add inline CSS
-
Fine-tune jQuery selectors
-
Change the timing of the change from synchronous to asynchronous
Step 3. Add audiences (optional)
Audiences allow you to decide who will see your experiment.
The default audience is all visitors to your site (Everyone). Click () to add any existing audiences to your experiment. Or, click Create New Audience to build a new audience.
You can combine multiple audiences in your experiment using AND and OR conditions. To learn more, check out our article on setting up Audiences.
Step 4. Add metrics
Add the metrics that measure success for your experiment. If the changes in your variation are successful, what will you measure to show improvement?
Create a metric from an existing event or create a new event for the experiment. To add an existing event, click the plus ()
The first metric you add is the primary metric for the experiment. This metric determines whether your experiment "wins" or "loses," and should track an event that is directly affected by the changes you make in your experiment.
Optimizely's Stats Engine makes sure that the primary metric reaches statistical significance as quickly as possible. You can also add secondary metrics to measure the downstream effects of your experiment.
To complete the experiment setup, you must add at least one metric. You can change, remove, or add new metrics to your experiment later. Click Save when you are finished adding metrics to your experiment.
Step 5. Set traffic allocation
Set traffic allocation to specify how traffic will be split between your variations. Optimizely Web Experimentation randomly allocates traffic into different variations, including the original.
If you like, you can change the fraction of traffic that goes into each variation. Or, you can leave it as is. You can also change the total traffic that goes into the experiment as a whole.
Step 6. Test and publish
After you set up the components of your experiment, preview it to make sure it looks and works the way you intend.
Click Preview to view visual changes for your variation.
See Preview tool to test the functionality of your campaign.
Not seeing your changes in Preview mode? Make sure your snippet is implemented on this page and configured to include Optimizely Web Experimentation.
See the comprehensive checklist of what you need to consider before fully testing your experiment, or go deeper and learn about advanced testing and troubleshooting.
When everything looks and works the way you want, click Start Experiment to set the experiment live for visitors.