As the name implies, A/B testing is essentially running an experiment testing two (or more) versions of something in order to learn which version of that something will work best according to a particular goal over time. An important note here is that in order to run an A/B test most effectively, you will want to ensure there is only one variable being tested. For a basic Sponsored Brand ad, this would be testing different versions of copy and keeping the product lineup the same or vice versa.
Establish your copy or product lineup–which variable are you planning on testing? Do you want to better understand if your customers resonate with certain pieces of copy more than others, or if they care about the star ratings and review count of a certain set of products more than another set?
Focusing on one variable will allow you to know with greater certainty what worked and what didn’t. If you test multiple variables, you won’t know which variable caused the success.
A generic name for a product test could be naming the campaigns in a typical fashion but adding “ – Product Test A” or “ – Product Test B” to the end. This will make it easier to quickly search “Product Test” in the Seller Central Ad Console search bar and find them, as well as to see at a glance how each is performing over time side by side.
Having a great variable to test won’t help you until you actually test it. Create any needed assets and get into Seller Central to build out your A/B test.
After two months (a solid test period in which a good or bad one-month period can be ruled out), test your next set of variables to determine the best possible performers within your product and copy sets.
For a Dog Toy Brand, an A/B test was run testing which sets of products featured in a Sponsored Brand would resonate with customers and perform with the most efficient outcome in that particular market – two different version of a stuffed animal toy, two different versions of a treat, and their flagship dog toy in both.(An A/B test had been run previously testing different versions of copy, with an outcome that indicated which piece of copy to use for the Dog Toy Brand’s Sponsored Brand ads going forward.)
Beginning the product test, the copy for each Sponsored Brand remained the same, and the test was run for two months targeting the same keywords with the same bids and budgets. Over the course of the test period, Test A outperformed Test B handily with an overall higher return on investment of 3.42 compared to Test B’s 1.26, a higher click-through-rate (2.61% vs. 2.22%), and overall more consistent performance. After analyzing the learnings, Test B was turned off in favor of Test A which was then allocated the remaining budget.
While running an A/B test may seem like a small detail, it can save advertisers and brands a lot of heartache in the long run. In the test above, for example, running the A/B test allowed us to see what people were actually looking for and were more likely to convert on - simply choosing what products you think will be best without testing options leaves room for potential lost sales and a disconnect with the market.
If only the products/copy contained in Test B had been built out and we had not tested it alongside Test A, we may have been left with an underperforming Sponsored Brand ad and drawn incorrect conclusions about what needed to change. In the advertising space, adaptability will always be necessary as markets and circumstances change, and with A/B testing you can rest assured knowing that the best possible Sponsored Brand ad for your brand is the one that’s left standing at the end.
Want to learn more about advertising best practices? Check out our blogs on Keyword Match Types on Amazon and Hidden Tricks to Maximize Efficiency on Amazon DSP, or download our ebook: The Experts' Guide to Amazon Advertising Strategy.
Find relevant content to accelerate your ecommerce business. Stay on top of industry trends and best practices.
Walmart.com has announced important changes regarding the “Was Price” and promotions on the digital marketplace. These updates make it more important than ever to optimize your price through implementing proper strategies, controlling your distribution channels, and being intentional about your pricing strategy.
And, as with all digital marketplaces, succeeding on Walmart.com requires performing well in all areas of The Ecommerce Equation. Which means as you optimize your listings’ pricing, as well as traffic, conversions, and availability, your revenue increases.
Pattern has the resources ecommerce brands need to optimize on marketplaces for each factor in the ecommerce equation. We have the technology and strategists to help you improve your traffic, the brand dedication and passion to help you achieve greater conversions, connections to econtrol specialists who help brands regain marketplace control, and the data you need to be able to make smart forecasting decisions for better product availability.
Below, we’ll cover how Walmart.com’s recent platform changes impact ecommerce brands’ ability to drive traffic and conversions for their products and how to strategize around them to work best in your brand’s favor. But first, let’s go over the changes themselves.
Walmart.com’s newest changes reflect their mission to be the leader in low, everyday pricing. Therefore, Walmart’s customers come to the platform and expect low prices no matter what. Overall, these updates give consumers more visibility into the value they’re experiencing and hold brands more accountable in the pricing information they display.
Due to Walmart’s updates, in order for your products to qualify for a strikethrough and show “Reduced Price” or “Clearance” flags on Walmart.com, your product’s promotion must be at least 10% off the “Was Price.” (Note: “Reduced Price” is the most common type of badging. Your teams can request this badge when filling out promotion upload files.)
To specifically qualify for “Clearance,” the product needs to be discontinued and no longer replenished after selling through the remaining inventory.
Although “Rollback” is sometimes seen on site, it is a form of 1P-only badging.
Walmart now prohibits promotions lasting longer than 365 days.
Walmart’s “Was Price” was previously loosely defined and manually inputted on Walmart.com as an MSRP. Now, stricter rules are in place with regulations in the broader market to encourage enforcement and protect consumers.
The “Was Price” is now defined by these terms on Walmart:
Either the 90-day median price paid by customers for the item on Walmart.com (excluding special promotions like holiday campaigns, limited time deals, rollbacks, and clearance);
Or the median price offered by Walmart or Marketplace sellers for the item on Walmart.com for at least 28 out of the last 90 days (excluding special promotions like holiday campaigns, limited time deals, rollbacks, and clearance).
To protect your “Was Price” from price erosion, be intentional when planning promotions. To be most effective in your promotion, you’ll want to be able to give your customers a large enough discount to qualify for the slash-through and reduced price badging.
Without the right pricing strategy in place, your products are in danger of falling into deeper and deeper discounting as you chase the ability to achieve slash-throughs and proper badging. Without the slash-throughs and badging, you’ll lose the ability to easily communicate the increased value of your product and the traffic and conversions you’re trying to earn by running the promotion in the first place.
It’s important to keep your products’ prices as steady as possible to protect your promotion periods. As you prevent high-low price fluctuations, you’ll be able to use slash-through prices and promotional badges like “Reduced Price” and “Clearance” to your advantage in driving better traffic and conversions for your listings.
Without the ability to display badging, a promotion falls flat even if the price has been dropped. With steady pricing over time, you’ll be able to keep a stable “Was Price” and ultimately enjoy more rewarding promotional periods long-term.
It’s important to remember that the “Was Price” policy also applies to 1P and other 3P sellers representing your products on Walmart.com. Unfortunately, your other strategies will be ineffective if other sellers are breaking your MAP policy or playing the high-low price game. So, it’s more important than ever for brands to be conscious of their distribution channels and keep rogue and unauthorized sellers in check.
By allowing Pattern to be the authorized seller of your brand’s products and working with Vorys eControl law firm to eliminate rogue sellers, you can be confident in creating and executing a powerful selling strategy on Walmart.com and other digital marketplaces. As a 3P seller partner, Pattern is truly invested in our partners’ success, we’ll help you to create and execute a strategy that truly prioritizes the long-term performance of your products on digital marketplaces.
Contact us today to learn more about the changes on Walmart.com and how you can optimize your performance.
Pattern’s Accelerate22 event, the global ecommerce acceleration summit, provided a way for participants to learn from each other and leading experts about building a successful ecommerce presence. During our Brand Control and Compliance track, Leslie Hensell, co-founder of Riverbend Consulting and an Amazon expert, spoke to attendees about “Bezophobia”—the fear of losing brand control on Amazon. She talked about the importance of having a clear strategy to help you perform your best on the digital marketplace and the fact that achieving that is much harder to do in a 1P Amazon relationship.
With better control, which is more achievable in a 3P relationship, brands can let go of their fears and more richly enjoy the inherent benefits of selling on Amazon. If you think you could have a case of Bezophobia, read below for three important areas every brand should have control over when selling on Amazon.
Pricing is a huge concern for brands selling on Amazon—in most cases, Amazon prioritizes their customers’ happiness and providing a great experience for them on the platform over brands’ best interests. So, they want to offer their customers the best price available at all times.
This seems harmless enough until a rogue or unauthorized seller enters the ecommerce space. They’d like to capture your consumers’ interest as well, and often list your products at a lower price than you’d authorize. When Amazon notices the change, whether on its platform or on another, they drop your listing price to match.
Many brands seriously struggle to raise their prices after events like this occur, leading to what we call the Profitability Death Spiral. As your product prices fall, it’ll be harder and harder to raise them again, especially if you’re operating with Amazon as a 1P seller.
At Pattern, we know brands can’t achieve marketplace acceleration without brand control. So, we partner with econtrol firm VORYs to allow all brand partners to better understand their distribution channels and how to address control problems that ultimately lead to pricing issues.
The next key area of control brands should be focused on is their product selection on Amazon. Leslie spoke about this being a common issue for brands—as mentioned above, Amazon doesn’t see your brand as its top priority.
Many brands provide a certain assortment of their products to Amazon to sell, then find that their expectations don’t match Amazon’s efforts. Leslie has worked with many brands that have believed that Amazon will list, market, and move product the way a brand would if they were managing their Amazon presence themselves.
But, in a 1P relationship, it’s difficult to get true visibility into what’s really going on. If Amazon buys your products without putting the effort in to represent your product selection in the way you think, it can cause big, long-term issues that are very difficult for brands to reconcile.
In Leslie’s experience, this is a brand’s most important area to have control over on Amazon. Your ability to sell products is completely dependent on how you’re able to showcase those products through your content. And, in a 1P relationship, brands lose the ability to have the final say over how their products appear to consumers.
Leslie has seen many cases of brands’ sales dropping inexplicably, only for them to discover that their vendor has made significant changes to product detail pages and other marketing materials, such that they no longer reflect the brand.
Pattern understands how important your brand representation is on digital marketplaces like Amazon. So, when we agree to partner with brands, we provide a suite of creative services to help your products look their best, including a studio team for fully-optimized pictures and videos and an expert advertising team that knows how to write descriptions and copy that really help your products stand out among the competition.
If you’re able to get ahead and get in control of your Amazon strategy, especially in your pricing, selection, and marketing efforts, you have no need to fear the digital marketplace. As an Amazon expert and ecommerce accelerator, Pattern knows what it takes for brands to truly succeed, and is committed to helping all brands take charge of their strategy to achieve long-term success.
Set up a call to talk more about Amazon and ways Pattern can help you make the platform work better for you.