The way A/B testing is done in many—if not most—companies today, p-values and significance are pretty much meaningless. Still, decision models often only allow treatments to be implemented if they achieved a "significant uplift". One better alternative is to employ a Bayesian approach which allows to report probabilities for minimum uplifts and to calculate ROI on a case-by-case basis.
Category: Data Analysis
How to Data Analytics (in a Start-up)
1) Data analytics is a lot like UX design. 2) Define the questions to be answered beforehand. 3) Data is meaningless without interpretation. Extensively collaborate with other departments.
Happiness—How Does It Work?
Traurig sein hat keinen Sinn, die Sonne scheint auch weiterhin. — Farin Urlaub: "Sonne" (2005) I know, I know. Not yet another one of those "How to find happiness" articles 🙄. So why am I writing this anyway? First of all, I think that writing is probably the best way of self⸗reflection—sadly, an art that is performed way… Continue reading Happiness—How Does It Work?
What Do Highly Successful Start-ups Have in Common?
Abstract: In the first year, a clear majority of the investigated companies secured more than $0.395m of seed or angel funding; in the second year, a clear majority secured more than $4.366m of Series A or venture funding; and in the third year, a clear majority secured more than $11.131m of Series B funding. At… Continue reading What Do Highly Successful Start-ups Have in Common?
My 2015 in Blogging
In 2015 I was not as busy as last year when it came to blogging, mainly due to my new job and my PhD thesis. But still, the WordPress.com stats helper monkeys prepared a very nice 2015 annual report for Twenty Oh Eight. I vow that I'm gonna post more regularly again next year! In case… Continue reading My 2015 in Blogging
How ’bout some fancy dashboards for ya? Power BI vs. Geckoboard
In my capacity as the chief data analyst of bitstars, it's one of my key responsibilities to regularly compile all relevant figures concerning our web platform HoloBuilder. These figures are mostly intended for people who don't have the time to dive deeply into some fancy but complicated statistics. Hence, from the user experience perspective it's… Continue reading How ’bout some fancy dashboards for ya? Power BI vs. Geckoboard
How to do Power Law Regression in R, or What Happened When One of my Posts Made it to the Front Page of Hacker News
Recently, my post about motherfuckingwebsite.com was featured on the front page of Y Combinator's Hacker News. I was watching football with some friends when my WordPress app told me twice that my blog's stats "are exploding". Back at home, I checked my stats and noticed that I had almost 6,000 unique visitors and over 7,000 views… Continue reading How to do Power Law Regression in R, or What Happened When One of my Posts Made it to the Front Page of Hacker News
2008 – Tales of Design & User Experience 