November 10 – 12, 2020

Online Edition!

Testing on Production, deep backend edition

Mykola Gurov

Live systems behavior tends to be difficult to predict before deploying a significant change to production

Pre-Production environments are better suited for verifying expected behavior, not for discovering unknown unknowns

Testing on production requires certain level of observability, resilience and recoverability which can be a valuable side-effect of this practice.

EUROPE'S GREATEST AGILE SOFTWARE TESTING FESTIVAL!

Testing on Production, deep backend edition

Production is a first-class testing environment

Why do we test on production? Why not avoid this risk at any cost?

Thorough testing before merging to master is great, but it doesn’t cover the unknowns. Staging on shared environments tends to be slow, unreliable and costly to support. Why not just learn from the only true environment by conducting safe and efficient experiments?

This talk is based on my experience of “shifting to the right” testing within the context of back-end systems of bol.com (one of the biggest online retailers of the Netherlands; logistics and purchasing domains), where correctness is often a bigger concern than performance, and recovery might require a bit more than users hitting the refresh button of their browser.

Testing on production is often associated with A/B testing or canary releases, but those aren’t always the best – or even applicable – techniques. We will look instead at shadow and dry runs, controlled experiments, survival of the fittest; how to apply these techniques and what to be aware of.


More Related Sessions


150-min Workshop

14:25-17:25 Creative Space Room - Track 9: Workshops

ScrumTale simulation game

Equipment required

120-minute Workshop

10:25-12:25 Room E2 + E3 - Track 5: Remote Talks

Designing a Continuous Delivery Pipeline

30-minute Talk

11:10-11:40 Room E1 - Track 4: Talks

Multiple Selves?!

If you like AgileTD you might also be interested in :

Your privacy matters

We use cookies to understand how you use our site and to give you the best experience on our website. If you continue to use this site we will assume that you are happy with it and accept our use of cookies, Privacy Policy and Terms of Use.