Skip to main content

Scaling up test automation

25-minute Talk

Dutch Lotteries uses the same Robot Framework repository with 14 testers. Our approach can be scaled up further. How do we maintain quality across multiple test suites?

Virtual Pass session

Timetable

10:45 a.m. – 11:30 a.m. Wednesday 26th

Room

Room F2 - Track 2: Talks

Collaboration & Communication Test Automation Testing Tools

Audience

Testers working on test automation in teams. Managers who want to increase test automation quality.

Key-Learnings

  • How to maintain the quality of test suites at scale.
  • How to teach an organization to make good test automation.
  • How standards can help you.

with Robot Framework

At Dutch Lotteries (Nederlandse Loterij), we work in a single Robot Framework repository with 14 testers across 9 teams. Due to the number of testers, we encountered many issues. Each of the 14 test suites used a fundamentally different approach. The same functionality was built everywhere but never in the same way. Even the most experienced programmer could not read the code.

We archived multiple particularly awful test suites. They got so bad that we gave up so we could start from scratch. Some were archived twice! We didn't see a green pipeline for months

Building quality test automation at scale is hard, especially when people of various skill levels are involved. This results in clashing approaches, accidentally rebuilding existing functionality, bad code, and inconsistency. We'll take a look at what worked for us:

  • Test Automation Guild to raise skill levels

  • Required reviews as a teaching tool

  • Build well-documented and flexible shared functionality

  • Structure the repository for clear scopes and flexibility

  • Write team-specific standards

  • Make lint rules to enforce our standards

These approaches will also work for you. Prove me wrong.

Related Sessions

Virtual Pass session
Wed, Nov 26 • 1:30 p.m. – 2:30 p.m.
Room F1+F2+F3 - Plenary

45-minute Keynote

Collaboration & Communication Leadership Quality Coaching

Virtual Pass session
Tue, Nov 25 • 11:45 a.m. – 12:30 p.m.
Room F3 - Track 3: Talks

25-minute Talk

Career Development Coding for Testers Test Automation

Deep Dive session
Wed, Nov 26 • 11:45 a.m. – 12:30 p.m.
Room D1+D2 - Track 6: Test Automation Deep Dive

25-minute Talk

Test Automation

Deep Dive session
Thu, Nov 27 • 10:45 a.m. – 12:30 p.m.
Room D5 - Track 8: Security Testing Deep Dive

105-minute Workshop

Artificial Intelligence (AI) Security Testing Test Automation