We Need to Get Rid of Significance in A/B Testing (ToDUX Newsletter #1)

Dear Subscribers,

Welcome to the first issue of ToDUX (= Tales of Design & User Experience; I’ve skipped the “& Other Stuff” for the acronym).

But first things first—thank you all so much for joining my mailing list. I feel very honored. 🙂

As promised, I want to use this newsletter to inform you about new posts and articles of mine, either on my own blog or elsewhere. On Tuesday, my first contribution to the ACM Interactions magazine (“a publication of great influence in the fields that envelop the study of people and computers,” as per their own website) has been published in their blog section. It will also appear in the March/April issue of the print magazine. 🎉

I wrote this article mainly because I believe there is something fundamentally wrong with the way A/B testing is often being conducted and treated in industry, i.e., “run one experiment, look at the p-value, and you have the ultimate, objective proof if something works or not,” which is … questionable at best. Enjoy reading, and I’d love to hear your feedback.

We need to get rid of significance, seriously! in the ACM Interactions blog

However, I don’t want to talk only about me, so I’m enclosing another article (not by me) that I’ve read recently and enjoyed very much:

When Customer Journeys Don’t Work: Arcs, Loops, & Terrain by Stephen P. Anderson on Medium

Thus far for this first issue. Read you next time!

Cheers,
Max

I love coffee, and if you enjoy what I write, you can spend me one if you like.



This is an issue of my newsletter Tales of Design & User Experience (& Other Stuff)—abbreviated ToDUX—that has been cross-posted here for archival reasons. If you want to get my latest takes and writing delivered straight to your inbox, you can subscribe at maxspeicher.com/newsletter. 🗞

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.