The Five Quality Metrics You’ll Ever Need

30-minute Talk

The important metrics are not internal ones: code coverage, bugs caught or test cases executed. Measure outcomes, not activities. Track actionable metrics and analyze them to gain deep knowledge.

Timetable

2:25 p.m. – 2:55 p.m. Tuesday 5th

Room

Room F2 - Track 2: Talks

Audience

Managers, Testers, Product Owners

Key-Learnings

  • Learn what are the five most important quality metrics to track.
  • Measure outcomes instead of activities. Focus on customer centric metrics.
  • Learn a powerful statistical technique that will help you extract wisdom from the numbers. Know if the variation you see is normal or it is time to ac
  • Learn how to predict and plan for the future with 99% accuracy and learn how to recognize the early signs of a major shift happening in your system.
  • Evaluate the exact impact of every new initiative on the quality of your product.

How can you measure the impact of a quality improvement initiative? Did the adoption of test driven development made any difference? By how much, exactly? Or maybe the three additional QA engineers were better investment? Can you predict with 99% accuracy how many customer complains you’ll receive next week? How many hotfixes you’ll need to work on? And how can you measure such an elusive concept as “quality” anyway?

We drown in a sea of data and yet we can’t seem to make any sense of it. It’s so overwhelming for the most of us that we just give up. We continue to make decision based on gut feelings and anecdotes from conference presentations.

This talk will focus on the five most important quality metrics (bug count before release is not one of them, nor is code coverage percentage). Those metrics are actionable, focused on outcomes instead of activities. They balance and complement each other. They are simple and yet very powerful. I’ll show you how we use them daily at Falcon.io to guide our development process, evaluate solutions and act as an early warning system.

You will also learn a very powerful and statistically proven way to analyze the numbers behind the metrics and convert information to knowledge and knowledge to wisdom. You will know when it is time to take an action and when the variation you observe is normal. This technique alone will significantly improve your forecasting and planning capabilities.

Related Sessions

Mon, Nov 04 • 9:00 a.m. – 5:00 p.m.

Full-Day Tutorial (6 hours)

Tue, Nov 05 • 11:10 a.m. – 11:40 a.m.
Room F2 - Track 2: Talks

30-minute Talk

Wed, Nov 06 • 10:25 a.m. – 12:25 p.m.
Room D5+D6 - Track 6: Accessibility Deep Dive

120-minute Workshop

Tue, Nov 05 • 4:55 p.m. – 5:25 p.m.
Room F1 - Track 1: Talks

30-min New Voice Talk