The Importance of Sponsored Brands A/B Testing

Bailey Bezzant

August 13, 2021

What exactly is A/B testing?

As the name implies, A/B testing is essentially running an experiment testing two (or more) versions of something in order to learn which version of that something will work best according to a particular goal over time. An important note here is that in order to run an A/B test most effectively, you will want to ensure there is only one variable being tested. For a basic Sponsored Brand ad, this would be testing different versions of copy and keeping the product lineup the same or vice versa.

How to set up an A/B test for Sponsored Brands

1. Decide which variable you want to test

Establish your copy or product lineup–which variable are you planning on testing? Do you want to better understand if your customers resonate with certain pieces of copy more than others, or if they care about the star ratings and review count of a certain set of products more than another set?

Focusing on one variable will allow you to know with greater certainty what worked and what didn’t. If you test multiple variables, you won’t know which variable caused the success.

2. Establish your campaign naming conventions

A generic name for a product test could be naming the campaigns in a typical fashion but adding “ – Product Test A” or “ – Product Test B” to the end. This will make it easier to quickly search “Product Test” in the Seller Central Ad Console search bar and find them, as well as to see at a glance how each is performing over time side by side.

3. Build!

Having a great variable to test won’t help you until you actually test it. Create any needed assets and get into Seller Central to build out your A/B test.

4. Repeat

After two months (a solid test period in which a good or bad one-month period can be ruled out), test your next set of variables to determine the best possible performers within your product and copy sets.

**An Example:**

For a Dog Toy Brand, an A/B test was run testing which sets of products featured in a Sponsored Brand would resonate with customers and perform with the most efficient outcome in that particular market – two different version of a stuffed animal toy, two different versions of a treat, and their flagship dog toy in both.(An A/B test had been run previously testing different versions of copy, with an outcome that indicated which piece of copy to use for the Dog Toy Brand’s Sponsored Brand ads going forward.)

Beginning the product test, the copy for each Sponsored Brand remained the same, and the test was run for two months targeting the same keywords with the same bids and budgets. Over the course of the test period, Test A outperformed Test B handily with an overall higher return on investment of 3.42 compared to Test B’s 1.26, a higher click-through-rate (2.61% vs. 2.22%), and overall more consistent performance. After analyzing the learnings, Test B was turned off in favor of Test A which was then allocated the remaining budget.

Test A:

Dog Toy Test 1

Test B:

Dog Toy test 2

Why is A/B testing Sponsored Brands important?

While running an A/B test may seem like a small detail, it can save advertisers and brands a lot of heartache in the long run. In the test above, for example, running the A/B test allowed us to see what people were actually looking for and were more likely to convert on - simply choosing what products you think will be best without testing options leaves room for potential lost sales and a disconnect with the market.

If only the products/copy contained in Test B had been built out and we had not tested it alongside Test A, we may have been left with an underperforming Sponsored Brand ad and drawn incorrect conclusions about what needed to change. In the advertising space, adaptability will always be necessary as markets and circumstances change, and with A/B testing you can rest assured knowing that the best possible Sponsored Brand ad for your brand is the one that’s left standing at the end.

Want to learn more about advertising best practices? Check out our blogs on Keyword Match Types on Amazon and Hidden Tricks to Maximize Efficiency on Amazon DSP, or download our ebook: The Experts' Guide to Amazon Advertising Strategy.

Explore Our Ecommerce Resource Library

Find relevant content to accelerate your ecommerce business. Stay on top of industry trends and best practices.

Improve Your Amazon Advertising Strategy With One Simple Metric: True RoAS
Blog

Improve Your Amazon Advertising Strategy With One Simple Metric: True RoAS

The purpose of advertising on Amazon is simple: increase traffic and conversions. But the approach to get those conversions is not always so simple. Your Amazon advertising strategy is based on current ad data and performance results such as your return on ad spend (RoAS). 

At a minimum, your RoAS number tells you how well you’re maximizing your ad spend. The problem is the RoAS you’re getting from Amazon or an advertising agency isn’t always accurate. 

As a top 3P seller on Amazon, Pattern helps brands improve their Amazon advertising strategy and results by providing them with one simple metric: true RoAS.

Understanding True RoAS

To understand why true RoAS is helpful to brands, you need to understand how Amazon and other agencies calculate and present your RoAS.

The key to growing your brand and maximizing your ad spend is to drive incremental traffic, rather than cannibalizing what has already taken place. For example, if you are selling probiotics, and paying for sponsored ads to win the keyword “probiotics for women”, but also organically ranked in the top results with the same keyword, that’s cannibalization. The RoAS score you would receive from Amazon includes that level of cannibalism, which inflates the number, causing you to pay more on ad spend. The best ads drive incremental growth instead of cannibalizing organic sales. 

At Pattern, we’ve created the acceleration software to make sure brands are getting their “true RoAS”. Pattern’s patented tool applies artificial intelligence to advertising to maximize incremental growth or true return on investment. 

Our software helps brands optimize their efforts by providing live and updated information on where your brand is not organically ranking, and what you should be paying for. If your ranking improves in one area, the ad spend will automatically decrease for those words or phrases until the software detects a drop in ranking, signaling that your ad spend should go up again. This dynamic monitoring of ad spend will help you maximize incremental growth and improve your RoAS.

Improve Your Amazon Ad Strategy with Pattern

Knowing your true RoAS is key to improving your Amazon performance. Advertising agencies and marketplace account managers often give you an inaccurate RoAS ratio or value, which only incentivizes you to spend more on advertising, ultimately increasing revenue for the agencies and/or marketplaces.

At Pattern, a 3P partner on Amazon and other marketplaces, we view our brands just as that: a partnership. When you win, we win. You succeed on Amazon by maximizing your ad spend and we have the data and resources to help you do just that. Accurate, transparent data and reporting will help improve your advertising strategy to drive more traffic to and conversions on your products. 

Ready to finally get your true RoAS? Contact us.   

Slowing Inflation is Music to Consumers’ Ears
Blog

Slowing Inflation is Music to Consumers’ Ears

**Instrument Pricing Changes Tune Amid Record Inflation** Compared to 2022, consumers should expect to pay more for musical instruments, but the rate of inflation shows signs of slowing. **The backstory:** America’s most popular musical instruments saw a notable price increase in 2022 compared to 2021, but the rate of inflation eased in Q4 ’22. **Why it matters:** Slowing inflation within this product category could indicate economic pressures like increased demand, rising labor costs, and supply chain disruptions are easing across the consumer landscape. **What we’re seeing:** The average cost of musical instruments increased 7.5% from 2021 – 2022; however, when analyzing individual increases year over year, some instruments saw price increases as high as 21%. <iframe title="YOY Price Change for Instruments — 2022 vs. 2021" aria-label="Bar Chart" id="datawrapper-chart-02Lwk" src="https://datawrapper.dwcdn.net/02Lwk/2/" scrolling="no" frameborder="0" style="width: 0; min-width: 100% !important; border: none;" height="379" data-external="1"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}(); </script> * Trombones experienced a 21.73% increase compared to 2021 * Trumpets +20.08% * Flutes +18.6% * Recorders +16.13% * Saxophones +13.63% * Clarinets +10.55% * Drums +5.41% * Ukuleles +5.17% **However:** Inflation among these same instruments was significantly less in Q4 ’22 compared to Q4 ’21. In some cases, prices decreased from Q4 ’21 – Q4 ‘22: <iframe title="Price Change for Instruments — Q4 2022 vs. Q4 2021" aria-label="Bar Chart" id="datawrapper-chart-6X6GZ" src="https://datawrapper.dwcdn.net/6X6GZ/2/" scrolling="no" frameborder="0" style="width: 0; min-width: 100% !important; border: none;" height="379" data-external="1"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}(); </script> * Trombones +11.23% * Flutes +10.41% * Saxophones +5.94% * Clarinets +5.59% * Trumpets +3.10% * Recorders +2.85% * Drums -2.59% * Ukuleles -8.46% **Moreover:** Certain instruments saw inflation reverse in 2022. On average, prices for melodicas, guitars, and violas saw their prices decrease by 4.41%, 3.19%, and 0.97%, respectively. <iframe title="YOY Price Change for Instruments — 2022 vs. 2021" aria-label="Bar Chart" id="datawrapper-chart-0Tefk" src="https://datawrapper.dwcdn.net/0Tefk/3/" scrolling="no" frameborder="0" style="width: 0; min-width: 100% !important; border: none;" height="259" data-external="1"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}(); </script> **Diving Deeper:** Inflation was more significant when comparing Q4 ’21 to Q4 ’20 than when comparing Q4 ’22 to Q4 ’21, indicating a slowing down of price increases for consumers. <iframe title="YOY Q4 Price Change for Instruments — 2020 – 2022" aria-label="Stacked Bars" id="datawrapper-chart-p6iqt" src="https://datawrapper.dwcdn.net/p6iqt/1/" scrolling="no" frameborder="0" style="width: 0; min-width: 100% !important; border: none;" height="206" data-external="1"></iframe><script type="text/javascript">!function(){"use strict";window.addEventListener("message",(function(e){if(void 0!==e.data["datawrapper-height"]){var t=document.querySelectorAll("iframe");for(var a in e.data["datawrapper-height"])for(var r=0;r<t.length;r++){if(t[r].contentWindow===e.source)t[r].style.height=e.data["datawrapper-height"][a]+"px"}}}))}(); </script> * In Q4 ’21, average prices for all instruments were up 8.89% compared to Q4 ’20. * When comparing Q4 ’22 to Q4 ’21, the average price for all instruments only increased by 2.65%. **The takeaway:** While consumers should expect to pay higher prices for instruments this year, overall inflation impact within this product category appears to be slowing down. With National Ukulele Day coming up on February 2, now is a great time for ecommerce brands to take advantage of slowing economic worries and reach new consumers. * Want Pattern’s data science team to power your brand with consumer insights like these? Contact us to [request more information](https://pattern.com/contact-us/) today.

Slowing Inflation? What Musical Instrument Pricing Tells Us
Blog

Slowing Inflation? What Musical Instrument Pricing Tells Us

It’s safe to say consumers and brands alike are eager for a change to the pattern of rising inflation, steadily increasing in many ecommerce categories . Pattern’s internal team’s data scientists analysis of instrument pricing shows a glimmer of hope that inflation may be slowing, which would be great news for brands selling online.

At Pattern, we’re interested in and monitoring trends and news related to pricing since price is a key factor in a brand’s profitability (as explained in the Ecommerce Equation). When brands are able to optimize their price, conversions, and traffic, they can optimize their profitability. And profitability leads to better allocation of resources, better brand control, and gives leaders the ability to expand their presence to new markets worldwide.

YoY Instrument Pricing Increased at a Slower Pace

When analyzing the pricing changes of instruments from 2021 to 2022, our teams found that prices increased, but at a slower rate than from 2020 to 2021.

As shown below, the year over year Q4 changes show quite a lower rate of increase.

Inflation Improvements Raise Profitability

Because inflation impacts online shopping behaviors, lower inflation can lead to better overall profitability for brands. This idea, of course, is nuanced, but Pattern’s Ecommerce Equation can help illustrate the general principle.

When inflation rises, consumers change their spending habits. Shoppers spend more time researching products, forego premium, higher-priced brands, and buy more in bulk. Brands tend to see a loss of loyalty as they’re forced to raise prices.

Price is a key variable in the Ecommerce Equation: price x conversion x traffic = profitability. As inflation lowers, brands can expect better performance in all of these areas—more traffic as spending habits return to normal, higher conversion from returning customers, and price that better fits consumer demand. As inflation lowers and these variables stabilize, brands will see profitability increase.

Raise Your Profitability with Pattern

As an ecommerce accelerator, Pattern is obsessed with gathering data that helps our brand partners succeed. We’ve created best-in-class technology, models, and analytics to understand changes on the horizon and inform our decisions. With an incredible team of data obsessed Pattern employees, we see what makes the difference in truly great ecommerce performance and apply those learnings for brand partners. 

Ready to improve your profitability? Contact us here.