Get started with Experiment Collaboration

  • Updated

With Experiment Collaboration, a hypothesis captures all the requirements, workflow, collaboration, data, and analysis for an experiment in one place.

Hypotheses enable teams to work effectively through Optimizely Experimentation. By tracking a hypothesis, a whole team can collaborate across the process of developing and executing an experiment: from a new idea in the backlog to a complete experiment with recorded results.

The following is a high-level overview that guides you through setting up Experiment Collaboration to manage your experimentation program. Click on the links to see more information and step-by-step instructions on how to complete specific actions.

Invite users and assign roles

To get started with Experiment Collaboration, you must invite users and assign them roles.

  • Roles – Dictate which modules users can access and which activity they can create.
  • Permissions  – Determine which activities or assets users can interact with, regardless of their role.
    • Types – View, Comment, and Edit.

The default permission is set to View All. Permissions also apply to teams. Assigning a user a workflow gives them Edit permissions to the task.

Standard role Seat limits Modules you can access Creation Viewing/Editing
Admin

20 combined (see following note)

Plan, Work Requests Hypothesis, Work Request

View and edit all Hypothesis and Work Requests

Creator View and edit based on object's share settings
Guest Unlimited Work Requests Work Requests View and edit objects directly shared with user
Users are counted from a separate pool of seats that is not shared with Experimentation. 20 seats are included, but you can purchase additional seats.

Configure a hypothesis brief

The next step is to set up a hypothesis brief template. Brief templates use fields to provide users structure and a consistent experience.

templates.png

Fields represent the metadata of the platform. You can reuse them to filter through hypotheses and activities. To get started, consider:

  • Which fields you would apply to your main program.
  • Which fields you would apply to your deliverables or other tactics.
  • Which fields would help you filter your activities and run reports. Think about how you want to organize your data.

fields.png

For information on creating and updating brief templates, see Manage hypotheses.

Configure a workflow

Next, configure your workflow. Workflows offer teams a structured, yet flexible process to ideate, design, approve, and launch experiments. Consider the following when configuring your workflow template:

  • The activities you need to do to launch an experiment.
  • The activities you do to conclude and share experiment results to other stakeholders.
  • If you have default assignees for certain steps.
  • The overall duration of each workflow setup.

workflow-template.png

For information on how to manage your workflow dates, see Manage hypotheses. For information on how to set up your workflow, see Hypothesis workflow.

Collaborate on the hypothesis

The hypothesis is where collaboration and experiment design takes place. Below is an overview of the actions you can do in a hypothesis:

collab-hypothesis.png

  1. Brief – Assign a brief template to document experiment design parameters.
  2. Variations – Upload variation designs as a screenshot or add a link to Figma, InVision, or Office365 and have the content unfurled.
  3. Proofing and Versioning – When uploading a screenshot or adding a URL of a live webpage, directly provide feedback and comment on the image.
  4. Update permissions and dates – Share the hypothesis with other team members to prompt discussion.
  5. Assign a workflow – Ensure teams are following a repeatable workflow.

See Manage hypotheses for information on creating a hypothesis, or Hypothesis workflow for information on updating a workflow.

Link experiment to hypothesis

Linking experiments to a hypothesis is currently in open beta. Contact your Customer Success Manager for more information.

On the Experiment tab, after connecting Optimizely Web Experimentation with Experiment Collaboration, you can link your Web experiments to your hypothesis. This lets you to easily reference and orchestrate your experimentation program from one place. link experiment view.png

See Link experiments to Experiment Collaboration hypothesis for step-by-step instructions on linking your experiments in the Experiment tab.

Plan experiment run dates

Instead of linking an experiment, you can manually add your experiment start and end dates and a URL reference to where you configured the experiment. Use experiment run dates to communicate when you plan to start or stop an experiment associated with your hypothesis. Toggle the Show on Timeline option to display the run date on the timeline view or off so that the run date does not display on the timeline view.

run-dates.png

See Manage workflow dates for more information on setting experiment run dates.

Share idea submission forms to crowdsource new ideas

In the Create Work Request module, you can use a brief template to set up an idea submission form. Use this to help centralize and structure idea submissions to ensure each idea contains the appropriate information and goes to the right team for review.

create-work-request.png

Upon approval, assigned stakeholders can initiate activities and start collaborating.

To build an intake process, define work request templates and routing rules. For more information, see Work requests.

Record results, share insights, and inspire action

You should dedicate a section in the brief to capturing the post-experiment analysis to inspire action and share learnings. You can document action items and assign them to individuals. 

results-summary.png

Set up a saved view in the Plan module with interesting result information to set up your own results repository.

saved-view.png