Product recommendation reports

  • Updated

Analytic reports for Optimizely Product Recommendations let you see the success of your campaigns and which Product Recommendations efforts work or do not work. You can track and view graphs for the following:

  • Total orders, revenue, and products sold
  • Order, revenue, and products sold through recommendations
  • Average order value and units per order uplift with product recommendations
  • Best performing pages
  • Best performing widgets

Attribution model

The Optimizely Product Recommendations attribution model is the industry standard. If someone visits your site and clicks on a product recommendation, and then returns to the site within 30 days and buys the product they clicked and converted on, then full attribution for the conversion is given to Product Recommendations.

Example

If a visitor engages with a product recommendation, returns to the site, and purchases the item, plus other items they were not recommended, Product Recommendations are only attributed to the revenue generated from the recommended item they engaged with and clicked—not the entire basket value.

For example, Product Recommendations recommends a t-shirt for $5.50 to a visitor while browsing the site. The visitor clicks the recommended t-shirt but leaves the site without purchasing. The visitor returns later that day and purchases two of the t-shirts that Product Recommendations recommended to them and they engaged with. They also purchase a jumper for $14 that Product Recommendations did not recommend. The order total is $25; the total revenue attributed to Product Recommendations would be $11 (2 t-shirts at $5.50 each). If the visitor buys multiple units of the same item that Product Recommendations recommended to them and they click, this collective sum is attributed to Product Recommendations. Equally, if it was just one item, the sole value of that one item is attributed to Product Recommendations.

Product Recommendations can produce a graph that plots attribution against time. This shows when most people convert after being shown a product recommendation. The metrics used are cost per click (CPC) against time. On average, 85% of conversions occur within 24 hours.

Image: Attribution model graph

Orders

The Orders tab shows orders from online channels that Product Recommendations tracks.

Image: Orders tab

  • Time range – You can edit the time range for the reports. Week is the default selection, which shows information from the past 7 days. You can also choose Month, 3 Months, or a custom time range. When you change the time range, click Update to refresh the results.
  • Currency – Select the currency you want to display in the report.
  • Export CSV – You can export any reports to a CSV file.
  • Total orders – The total number of transactions tracked on the site as two units of measurement.
    • Optimizely Recommendations – The number of orders in which an Optimizely product recommendation was purchased.
    • Average percentage from Optimizely recommendations – The percentage of orders in which an Optimizely product recommendation was purchased.
  • Total revenue – The total revenue tracked on the site as two units of measurement.
    • From Optimizely recommendations – The revenue generated from products bought through product recommendations is measured by totaling the unit value of products clicked and purchased from recommendations.
    • Average % from Optimizely recommendations – The percentage of total revenue from Optimizely Product Recommendations.
  • Products sold – The total number of units sold on the site.
    • From Optimizely recommendations – The revenue generated from products bought through Product Recommendations.
    • Average % from Optimizely recommendations – The average percentage of products sold from Optimizely Product Recommendations.
  • Average order value – The average value of orders that contained an Optimizely product recommendation compared to those that did not over the time range.
  • Average units/order – The average number of units purchased in orders that contained an Optimizely product recommendation compared to those that did not.
  • Revenue from Optimizely – A graphical view of the total revenue from product recommendations (left-hand axis) and % of product recommendation revenue (right-hand axis), with the time range on the baseline, to monitor the peaks and troughs in behavior.

    Prodrec-revenue-report.png

  • Orders, Revenue, and Products sold tables – Displays the order data in table format. You can organize orders, revenue, and products sold using the following columns.

    Prodrec-orders-report.png

    • Date – The date of the order.
    • Total – Total number of tracked transactions, revenue, or units sold for that date.
    • From Optimizely recommendations – Total number of orders, revenue, or units sold that contain or were sold through an Optimizely product recommendation.
    • % From Optimizely recommendations – The percentage of orders, revenue, or products sold that contain an Optimizely product recommendation.

Site Engagement

The Site Engagement tab displays page impressions, clicks, and click-through rates (CTRs) for product recommendations across your site.

Image: Site Engagement tab

  • Total impressions – The number of page impressions where product recommendations were served.
  • Total clicks – The total number of clicks on product recommendations.
  • Click-through rate – A percentage worked out on the sum of clicks divided by the sum of impressions.
  • Click-to-purchase conversion – A percentage calculated on the sum of purchased recommended products divided by the sum of clicks.
  • User recommendation conversion – The number of unique visitors who purchased a product recommendation, compared to the number of unique visitors who viewed a product recommendation, as a percentage.
  • Impressions versus click-through rates – A graphical representation of this information. The bars show the daily number of page impressions with product recommendations, and the line shows the daily click-through rate for product recommendations.
  • Site Engagement table – Displays the site engagement data in table format. You can organize the data by the following columns.

    Image: Site Engagement data

    • Date – The date of the engagement event.
    • Impressions – Total number of impressions.
    • Clicks – Total number of clicks.
    • CTR – Click-through rate. Percentage of product recommendations visitors clicked.
    • CTP – Click-to-purchase. Percentage of product recommendations visitors purchased after clicking.
    • URC – User recommendation conversion. Percentage of unique visitors who purchased from product recommendations out of unique visitors who saw product recommendations.

Products

The Products tab shows the best-selling products on the site based on the revenue generated from Product Recommendations.

Prodrec-products-report.png

  • Average order value – Shows the average order value of orders that contained an Optimizely product recommendation compared to those that did not over the specified period.
  • Average units/order – Shows the average number of units purchased in orders that contained an Optimizely product recommendation, compared to those that did not, again over the specified period.
  • Revenue from Optimizely – Shows revenue generated from Optimizely product recommendations daily through the period, providing a visual to see trends in behavior.

    Prodrec-RevenueGraphFromProducts.png

  • Best-selling products data table – The table in the portal shows the top 10 products. However, you can export a full list by clicking Export CSV. You can organize the data using the following columns.

    Image: Best-selling products data

    • Product code used to identify the product
    • Title of the product
    • Total number of units sold on the site
    • Number of units purchased through product recommendations
    • Total revenue of the product on the site
    • Total revenue of the product through product recommendations
    • Number of impressions
    • Click-through rate (CTR).
    • Click to purchase (CTP).

Page Types tab

The Page Types tab shows page types on the site where product recommendations are served and how much Product Recommendations revenue is generated from each page.

Image: Page Types tab

  • Page type report by revenue – A pie chart shows which page types generate the most product recommendation revenue.
  • Page Type data table – You can organize the data using the following columns.

    Image: Page Type data

    • Page type names where product recommendations are present
    • Number of impressions for that page type
    • Number of clicks on product recommendations for that page type
    • Click-through rate (CTR) for product recommendations, which is shown as a percentage, calculated by the sum of clicks divided by the sum of impressions
    • Items Bought shows the number of items purchased through product recommendations on that page type
    • Click-to-Purchase (CTP) rate for product recommendations shows a percentage calculated by the sum of purchased recommended products divided by the sum of clicks
    • Revenue generated from product recommendations on each page type.

Widgets tab

The widgets reporting page is similar to the Page type report but with finer detail for individual widgets because some pages may have more than one widget.

Image: Widgets tab

  • Widget report by revenue – The pie chart presented to visitors shows which widgets generate the most revenue.
  • Widget data table – Shows similar information as Page Types, except based on the widget level. Click a widget name to see the individual position performance details within a widget. You can organize the data by the following columns.

    Image: Widget data

    • Widget
    • Impressions
    • Position
    • Clicks
    • Click-through rate (CTR)
    • Items bought
    • Click to purchase (CTP)
    • Revenue

Server Metrics tab

The Server Metrics tab shows two graphs:

  • Number of product recommendations served per day

    Image: Daily recommendations

  • Average time it takes to generate product recommendations and return them to a site (that is, after a tracking request is sent)

    Image: Average generation time

Conversion summary tab

The Conversion summary tab shows the ranking of products based on their overall conversion and page views on a site. It does not focus on product recommendations but can provide accessible, actionable insights based on your whole site, visitors, and orders.

Image: Conversions tab, Summary view

Conversion definitions

  • High converting – Any product that is in top 10 of the highest 10% of conversions
  • Low converting – Any product in the lowest 10 of the lowest 10% of conversions.

Traffic definitions

  • High traffic – Any product in the top 30% of page views.
  • Low traffic – Any product that is in the lower 40% of page views and with the lowest 10% excluded.

The following list shows the various combination views of conversion data, which are displayed in the tabs on the Conversion summary view.

  • High converting, high traffic – The 10 best-converting products on the site from the top 30% of products with the most page views.
  • High converting, low traffic – The 10 best converting products on the site from the 40% of products with the least page views, excluding the 10% of products with the lowest number of page views.
  • Low converting, high traffic – The worst 10 converting products on the site from the top 30% of products with the most page views.
  • Low converting, low traffic – The worst 10 converting products on the site from the 40% of products with the least page views, excluding the 10% of products with the lowest number of page views, is displayed.

Image: Conversions and Traffic combinations

Rank and trend view

The Conversion rank and trend view lets you generate a Top 5 report of products, categories, or brands sold on your site based on a combination of criteria – best or worst performing by page views, revenue, or conversion. The generated report shows the total page views, units bought, conversion, revenue per page view, and total revenue from sales on your site.

Prodrec-rank-and-trend.png

Search tab

The Search tab shows the terms used in a site search that returned no results.

Image: Search Errors tab

You can sort by the following criteria:

  • The term that was searched
  • The number of times a term was searched
  • The number of unique visitors who searched for a term

AB tests tab

The AB tests tab shows the results from the latest Product Recommendations A/B test on a site and past tests.

Prodrec-AB-tests.png

You can do the following in the AB tests view.

  • Filter the results to specific dates.
  • Set the control group.

    A/B testing supports up to 5 groups, so you can view A-to-E testing.

  • Select a specific currency that you want to examine.
  • In the table, you can view and compare key metrics on the site between test groups, such as:
    • Visitor sessions
    • Site revenue
    • Conversion rate
    • Average order value through average selling price and units per order
    • Recommendation engagement and revenue

Daily charts

The Daily Charts view shows graphs for revenue generated, visitor-to-order conversion rates, average order value, average selling price, average number of units sold, and number of sessions per day on the site.

Image: AB revenue chart

Image: AB Visitor to order conversion

Image: AB average order value

Image: AB average selling price

Image: AB units per order

Image: AB sessions

Uplift charts

The Uplift charts view shows graphs displaying the revenue, conversion, and average order uplift value for a chosen test group versus the control group for the selected date range (which is cumulative) and over the past 7 days.

Image: Cumulative uplift chart

Image: Cumulative conversion uplift chart

Image: Cumulative average-order-value uplift chart

Summary tab

Image: Summary tab