Site Design: Looks like Slack is A/B testing a new marketing site

over 8 years ago from Adam Wintle, Experienced Product Manager and Maker

  • Dirk HCM van BoxtelDirk HCM van Boxtel, over 8 years ago

    A/B testing 2 wholly different things is a farce.

    What will you learn? Sure, one is better than the other, but how can you tell the colours, visuals and button placement is any good if you put a wholly different message atop it? And vice versa, of course.

    Just my two cents.

    6 points
    • Adam T.Adam T., over 8 years ago

      It's an easy way to make large changes while still making sure your conversion rates increase. It's hard to go from A -> B with incremental changes. Once they have a winner from this test, you can be sure they will go ahead and A/B test the smaller intricacies.

      10 points
      • Dirk HCM van BoxtelDirk HCM van Boxtel, over 8 years ago

        While I see what you mean, I don't think there's much to be learned other than "A worked better than B" or the other way around.

        You can't really say "having a more personal headline worked better", or draw any other meaningful conclusions.

        2 points
    • Thani SuchoknandThani Suchoknand, over 8 years ago

      You're right that its best to test small changes but they're probably just trying to confirm that conversion rates arent lower with the new design.

      1 point