Testing on Production, deep backend edition

Production is a first-class testing environment

Why do we test on production? Why not avoid this risk at any cost?

Thorough testing before merging to master is great, but it doesn’t cover the unknowns. Staging on shared environments tends to be slow, unreliable and costly to support. Why not just learn from the only true environment by conducting safe and efficient experiments?

This talk is based on my experience of “shifting to the right” testing within the context of back-end systems of bol.com (one of the biggest online retailers of the Netherlands; logistics and purchasing domains), where correctness is often a bigger concern than performance, and recovery might require a bit more than users hitting the refresh button of their browser.

Testing on production is often associated with A/B testing or canary releases, but those aren’t always the best – or even applicable – techniques. We will look instead at shadow and dry runs, controlled experiments, survival of the fittest; how to apply these techniques and what to be aware of.


Related Sessions


  • Tutorial
  • Keynote
  • Talk
  • Workshop
  • Combo
  • Bonus
  • Active
  • Social

30-minute Talk

15:10-15:40 Room F2 - Track 2: Talks

Deliberate Practice: What does it get us?

120-minute Workshop

10:25-12:25 Room D1+D2 - Track 6: Workshops

Servant Leadership: leaders go first!

30-minute Talk

16:10-16:40 Room F2 - Track 2: Talks

A quick guide to implement ATDD in Agile Teams-A Case Study

30-minute Talk

11:55-12:25 Room F3 - Track 3: Talks

Making (Business) Sense of Automated Testing

If you like the Agile Testing Days Conference you might also like: