Site Design: Looks like Slack is A/B testing a new marketing site

over 8 years ago from Adam Wintle, Experienced Product Manager and Maker

Dirk HCM van Boxtel, over 8 years ago
A/B testing 2 wholly different things is a farce.
What will you learn? Sure, one is better than the other, but how can you tell the colours, visuals and button placement is any good if you put a wholly different message atop it? And vice versa, of course.
Just my two cents.
6 points
- Adam T., over 8 years ago
  It's an easy way to make large changes while still making sure your conversion rates increase. It's hard to go from A -> B with incremental changes. Once they have a winner from this test, you can be sure they will go ahead and A/B test the smaller intricacies.
  10 points
  - Dirk HCM van Boxtel, over 8 years ago
    While I see what you mean, I don't think there's much to be learned other than "A worked better than B" or the other way around.
    You can't really say "having a more personal headline worked better", or draw any other meaningful conclusions.
    2 points
- Thani Suchoknand, over 8 years ago
  You're right that its best to test small changes but they're probably just trying to confirm that conversion rates arent lower with the new design.
  1 point

Now playing