How often do A/B tests run only to yield inconclusive data? Especially in the data feed and PLA world, the problem is prevalent. VersaFeed's new Dynamic Experiment solution solves this problem once and for all.
Our dynamic system will rotate experiments on/off randomly, through the entire test period, thus ensuring that there's no outside influences.
Here's the process:
-
You choose ONE set of products that will contain both your test group AND your control group (e.g., all shoes with ROAS < 5). Ideally, this singular group should be a few thousand products and not lower than one hundred products.
-
You create your test hypothesis data for the entire set of products. E.g., if you have a new title you want to test, you'd make that new title for every single item in your product set from (1) above.
-
You (or your VersaFeed rep) configure your account with a new Dynamic Experiment in the VersaFeed dashboard. Don't worry, it's painless.
-
Set it and run. Throughout the experiment, VersaFeed will dynamically turn on/off the experiment at the product level – in statistically sound combinations that ensure every product had some combination or both test and control. Custom Label assignments (e.g., "Test" or "Control") can be applied to corresponding/applicable products in tandem with each update to help track results.
Why is this magical?
-
Because we're turning the experiment on/off (at the product level) you don't have to worry about outside influences affecting your performance (e.g., a sale that unfairly boosts the test group). That same sale would now affect both groups equally.
-
You no longer need to find an "A" group and "B" group that have extremely similar performance stats to run your tests on - our tool has the ability to select the randomized groups. Just make a big ol' singular test group and let it rip.
Dynamic Experiments are available on all VersaFeed accounts starting January 1st, 2024.