As product managers, designers and marketers, we love the clarity that comes from A/B testing. We have an idea or design of what we want to test, a theory on why and we let the users behavior determine the outcome from a controlled experiment.

Be aware of A/B testing has limitations and variabilities possibly outside of your control.

  1. Assumes you have tested and have the right JTBD or Workflow.
  2. Limit of two options will save time and reduce cost but minimizes insights.
  3. Temporal effects can be seen from running the test to long or short.
  4. Benefits may be short lived or cyclical.
  5. Mode effect from different devices or screen sizes may skew results.
  6. Interaction effects can amplify results.
  7. The more tests you run, the higher the chance of error.
  8. It may not account for all intermittent or unknown variables.
  9. It’s not multivariate, mixed method or qualitative research.


There are multiple AR/VR startups thriving in 2019, despite sentiment to the contrary. Surmounting the early stage challenges that every new tech platform faces, AR/VR startups are finding innovative ways to survive and thrive. A few common themes came out of extensive discussions across the industry, and here’s what the CEOs had to say.

Data is essential for Product Managers

In today’s Product Management and Product Marketing world data is an increasingly important element. Understanding it, using it, processing it, protecting it or even selling it are all potentially important. Data can be used to make decisions about your product’s strategy, design and marketing as well as within your product to provide more insights for your customers and end users.