Category: Experimentation & Analytics
-
Putting a tracking plan together
I’m working on a project at the moment where we’re shifting our analytics infrastructure. This is an opportunity to revisit the fundamentals and clear out any cruft in our tracking plan. I start with the most important question (what success means to the people that use our product) and then work backwards from there. For…
-
How do people discover features in an app?
If we’re building a feature that only caters to 20% of our users then where do we put it? If we splash it in everyone’s face we’re just spamming 80% of the people who use our app. When our app only did one thing our core feature was 100% obvious. Now we have five features…
-
Measuring the impact of a product experiment
The broad strokes to running a product experiment are: Identifying a customer and/or business problem Coming up with a hypothesis for a solution Building the changes under a feature flag Running the experiment Review the results of the test Step 5, reviewing the results, doesn’t happen inside your feature flag manager. That typically happens in…
-
Running your first product experiment
The problem with a lot of the content around A/B testing on the web is that it only covers landing pages and e-commerce websites. I want to be able to run A/B tests on the words inside the product experience.Tools that test landing pages, like Google Optimize, VWO and Optimizely are client-side tools. They work…
-
What I Learned From My 12 Week CXL Scholarship On Conversion Rate Optimisation
I got accepted to the CXL Institute’s conversion optimisation mini-degree scholarship program. It claims to be the most thorough conversion rate optimisation training program in the world. The program runs online and covers 78 hours and 59 minutes of content over 12 weeks. As part of the scholarship, I had to write an essay about…
Josh Pitzalis 