A Journey toward Generative AI

25-minute Talk

The talk discusses the integration of generative AI tools in software development and testing, focusing on experiences at ZEISS, benefits, potential drawbacks, and effectiveness monitoring.

Virtual Pass session

Timetable

4:00 p.m. – 4:45 p.m. Wednesday 20th

Room

Room F1 - Track 1: Talks

Audience

Anyone interested in generative AI Tools

Key-Learning

  • How generative AI tools can be introduced effectively to a larger user base while minimizing any potential negative impact
  • What metrics can be used to continuously monitor the effectiveness of the tools
  • In what areas the tools show less effectiveness

Insights from integrating ChatGPT and GitHub Co-Pilot into Company Practices

Since their introduction, generative AI tools such as ChatGPT and GitHub Co-Pilot have promised great improvements in efficiency and quality across the entire software development lifecycle. GitHub has published impressive results, indicating a more than 50% gain in productivity, as well as substantial increases in employee satisfaction. These results are supported by similar findings from other sources. However, at the same time the number of publications observing potential negative effects of the tools is growing, as more data becomes available. Since AI-Tools make it easier to write code, they also make it easier to write code “that should never have been written in the first place”.

With that in mind when planning to introduce generative AI-Tools into a company, the question becomes: how can this integration harness the power of generative AI while effectively minimizing any potential negative impact?

In this talk I will share firsthand insight gained during our ongoing journey to introduce ChatGPT and GitHub Co-Pilot at ZEISS for Software Development and Testing. While focusing on testing use cases I will describe:

  • How we started our journey with an initial assessment.
  • How we continued the roll out of the tools to a wider user base at ZEISS.
  • What metrics we are planning to use to continuously monitor the effectiveness of the tools.
  • In what areas the tools showed less effectiveness.
  • What initial hypotheses did not work as expected.

With this talk I hope to provide you with key ideas and takeaways that will help you on your own journey toward generative AI, whether you are just starting out or are already on the way.

Related Sessions

2:45 p.m. – 4:45 p.m.
Room D1+D2 - Track 7: Workshops

120-minute Workshop

Deep Dive session
2:45 p.m. – 4:45 p.m.
Room E2+E3 - Track 5: Artificial Intelligence Deep Dive

120-minute Workshop

Deep Dive session
Virtual Pass session
10:45 a.m. – 11:30 a.m.
Room E2+E3 - Track 5: Artificial Intelligence Deep Dive

25-minute Talk

8:30 a.m. – 4:30 p.m.
F-,E- & D-Rooms

Full-Day Tutorial (6 hours)