Archive for the 'A/B Tests' topic

KPIs are Metrics, but Not All Metrics are KPIs

Thanks to Marco Dini for translating this post to Italian. “What are some good KPIs I should use to measure our UX?” This is a question that comes in quite frequently and, at its heart, it shows that they are confused about what a KPI is. A KPI is a Key Performance Indicator. It’s a [...]

Visitors Are Not All The Same – Moving Beyond Conversion Rates, Part 3

Moving Beyond Conversion Rates: You can read this in Italian thanks to Marco Dini. Part 1: Avoid Ratios for Metrics Part 2: Not All Visitors Make Great Customers Part 3: Visitors Are Not All The Same (this) Part 4: Campaigns Are Where Conversion Rates Shine Part 5: Measuring Money Left On The Table The electronics [...]

Not All Visitors Make Great Customers – Moving Beyond Conversion Rates, Part 2

Moving Beyond Conversion Rates: Part 1: Avoid Ratios for Metrics Part 2: Not All Visitors Make Great Customers (this) Part 3: Visitors Are Not All The Same Part 4: Campaigns Are Where Conversion Rates Shine Part 5: Measuring Money Left On The Table A few years back, the executives at the electronics retailer Best Buy [...]

Do A/B Tests Focus Us On The Wrong Problems?

Last week, I attended a conference presentation where a team presented findings from their A/B Testing efforts. It was a cute presentation where they posted the control and test variants, then asked the audience to pick which one “won” the A/B test. They compared the audience answer to the variant that demonstrated the best increase [...]