Skip to main content

Stop Waiting for CI. Start Getting Productive.

30-minute Vendor Talk

CI should validate a change, not be the primary environment for debugging failures.

Virtual Pass session

Timetable

3:45 p.m. – 4:30 p.m. Wednesday 18th

Room

Room E1 - Track 4: Talks

Continuous Integration/Continuous Delivery (CI/CD) Test Automation Testing Tools

Audience

Engineers, Tech Leads, Project Leads, Managers

Key-Learnings

  • Closely coupling integration tests to CI makes failures unnecessarily difficult to reproduce.
  • Reproducible integration test failures enable efficient debugging.
  • If done right, the push–wait–debug cycle can be replaced with fast local iteration.

Almost every software engineer has experienced the frustration of debugging integration tests through repeated CI runs. The test fails in CI, and every attempted fix requires another commit, another push, and another wait for feedback. The root cause is often simple: the integration test cannot be reproduced exactly outside the CI environment.

In this talk, we argue that this is not an inevitable part of software development, but a consequence of treating CI as a special environment. If developers can execute the exact same integration test in the exact same environment on their own machine, they can reproduce, analyze, and fix failures without ever pushing a change.

We demonstrate this workflow using Nix and the NixOS integration test framework, where complete integration test environments, consisting of networks of VMs or containers, and all its dependencies are defined from the ground up and executed identically both locally and in CI.

We will outline what it takes to adopt this philosophy in practice, discuss its limitations, and provide concrete guidance for applying it in existing projects.

Related Sessions

Wed, Nov 18 • 10:45 a.m. – 12:30 p.m.
Room E2+E3 - Track 5: Workshops

105-minute Workshop

Artificial Intelligence (AI) Testing Tools

Thu, Nov 19 • 1:30 p.m. – 4:30 p.m.
Room D3+D4 - Track 7: Workshops

180-minute Workshop

Test Automation

Virtual Pass session
Tue, Nov 17 • 2:30 p.m. – 3:15 p.m.
Room F2 - Track 2: Talks

25-minute Talk

Continuous Integration/Continuous Delivery (CI/CD) DevOps Machine Learning (ML)

Virtual Pass session
Wed, Nov 18 • 2:30 p.m. – 3:15 p.m.
Room D7 - Track 9: Talks

25-minute Talk

Artificial Intelligence (AI) Test Automation