If you are running a paid promotion campaign to drive traffic to certain product pages on your website, it is important to select a change frequency that will allow adequate visitor exposure to each test variant. For example, choosing a “Daily” change frequency would be a bad idea if you are only running the paid promotion for one day, but a “Daily” change frequency might be fine if you were going to run the paid promotion for 30 days (depending on how much traffic your store is getting).
Price Testing: Any time you change the price of your product (through Shopify directly or through our A/B testing app), there is a possibility of it occurring while a customer is in the middle of checking out. This will result in the mandatory recalculation of the cart, to reflect the price change. This is because Shopify will not honor the price that the customer saw when they added the product to their cart. Thus, it is best to select a change frequency for price testing such as 24 hours or greater, to lower the chance of this occurring. You can also schedule the test to start at a specific time of the day when you have the least amount of traffic, to further reduce this possibility.
