Skip to main content

Mapping Biases to Testing in the LLM era

25-minute Talk

We human beings are gullible. When we should slow down our thinking we often end up taking the mental shortcut instead: we are biased. The widespread use of LLM's seems to have worsened the problem.

Virtual Pass session

Timetable

3:45 p.m. – 4:30 p.m. Tuesday 17th

Room

Room F1 - Track 1: Talks

Other

Audience

Testers

Key-Learnings

  • system one and system two thinking difference
  • which biases happen when you use an LLM
  • cognitive risks of using an LLM

In this 2026 edition of Mapping Biases to Testing I will zoom in on biases I see happening when people use LLM's

Back in 2017, I gave a talk at this conference called "Mapping Biases to Testing". It was inspired by the book "Thinking, Fast and Slow" by Daniel Kahneman. In the talk I explained the difference between System One and System Two thinking, and I gave some examples of specific cognitive biases that I saw happening in myself and others at work.

Fast forward to 2026 and it feels prudent to freshen up this talk for the "LLM-era" that we seem to be living in.

We human beings are so mentally vulnerable and gullible. When we should slow down our thinking, we often end up taking the mental shortcut instead: we are biased. The widespread use of LLM's seems to have worsened the problem. The allure of offloading important (testing) tasks to a machine that doesn't care or feel is apparently irresistible for many of us. This comes at a cost: our own critical thinking skills, cognitive capabilities and other computer based skills we need to excel at our job are atrophying.

In this 2026 edition of Mapping Biases to Testing I will zoom in on biases I see happening when people use LLM's:

  • anchoring effect
  • confirmation bias
  • cognitive dissonance
  • availability heuristic
  • technology bias

I will close off with a plea to you to keep using your brain. We should all embrace the friction that comes with learning. Basically, come to this talk if you still care about using your brain.

Related Sessions

Tue, Nov 17 • 10:45 a.m. – 12:30 p.m.
Room E2+E3 - Track 5: Workshops

105-minute Workshop

Career Development Other

Virtual Pass session
Thu, Nov 19 • 1:30 p.m. – 2:15 p.m.
Room F3 - Track 3: Talks

25-minute Talk

Collaboration & Communication Other Testability

Virtual Pass session
Thu, Nov 19 • 11:45 a.m. – 12:30 p.m.
Room F1 - Track 1: Talks

25-minute Talk

Collaboration & Communication Other