NOV. 3 – 8, 2019


Measure it or it didn't happen

What I learned about quality KPIs over the last 5 years in testing

In order to improve quality, we have to find the right KPIs to measure progress

In order to improve quality, we have to find a way to measure progress. Also managers love KPIs. My experience started counting the tests executed vs the test failed. Since these numbers are far away both from the user value and from the health state of the product itself, I deemed them as irrelevant.

Next I started counting the bugs opened and closed per sprint. It had couple of downsides: its too simplistic and its’ easy to manipulate. 

I wanted less subjectivity and a more granular approach. From the tech side, I tried the mean between bug creation on release on live, downtimes, count of post mortems. From the user side, the number of ’non-issues’ was quite interesting. 

Let me take you on a KPI journey throught the metrics I tried, that worked and didn’t work for us and how I assessed them. I hope  some of them will help you as well.

More Related Sessions

15-min Consensus Talk

15:25-15:40 Room F1 - Track 1: New Voices

In sprint automation, build the culture.

30-minute New Voice Talk

11:10-11:40 Room F1 - Track 1: New Voices

3 questions that will help you create safe release planning

Full-Day Tutorial (6-hour Workshop)


Test Management in Agile

Equipment required


14:45-14:55 Room F3 - Track 3: Talks

T-Shaped Testing or How to Crucify Your Co-Workers

Other Events:

Your privacy matters

We use cookies to understand how you use our site and to give you the best experience on our website. If you continue to use this site we will assume that you are happy with it and accept our use of cookies, Privacy Policy and Terms of Use.