Managing the quality of AI systems: different than you think
Projektleitertreffen Hannover #MeetAtHome
with
>> This will be held in German language
In this presentation, you will learn why traditional approaches to quality assessment are no longer sufficient for generative AI - and what you as an IT project manager should pay attention to in order to achieve reliable results. In contrast to conventional IT systems, where errors such as blue screens, 404 pages or incorrect calculations are immediately noticeable, generative AI always provides an answer. As these results are often in text or voice form, they appear correct at first, but may be incorrect or inappropriate in terms of content. This makes the review complex and often remains subjective or unsystematic. The result: the system works technically, but is not usable!You will learn why such challenges occur and how you can respond to them in your projects. A key point here is the differentiation between naïve implementations of retrieval augmented generation (RAG), which are currently often considered the industry standard, and well thought-out RAG approaches that deliver significantly better results. Andre will show you which architectural decisions have a significant impact on quality and how to improve the performance of your GenKI systems.
In addition, you will learn how to systematically evaluate and control the quality of GenKI - with clear metrics, automated labeling and synthetic test data. These approaches will help you to achieve the most important goal of an IT project manager: a system that is used and creates real added value.
>> You want to learn more about quality assessment of generative AI? Then join us!
Andre Fuchs
Andre is a division manager at an IT service provider. As an author and trainer, he develops training courses and workshops on modern leadership, effective communication and working with generative AI systems. With his technical expertise and his focus on human-centered approaches, he manages to convey innovations in an understandable way and successfully put them into practice. In his presentations, Andre regularly provides insights into the latest trends and challenges in AI development. His passion lies in shaping technological advances in such a way that they create concrete added value for people and organizations.
https://www.linkedin.com/in/a4fuchs/
Participate
We will start an MS TEAMS session approx. 10 minutes before the start of the event and let you in on time. To participate, please use the TEAMS application on a device of your choice (Teams Download or App Store). Participation via browser is also possible. Registration with Microsoft is not required for participation.
The following link will initially redirect you to the registration page and will be changed to the Teams link on the day of the event.
https://link.pm-hannover.org/2025-02-20
During a presentation, please use the “Raise hand” function or the TEAMS chat for questions.
Please mute your microphones if you do not wish to speak.
Registration
Anyone wishing to claim PDUs must register for this meeting in advance via the PMI Germany Chapter homepage.
If possible, please enter your first and last name in TEAMS so that we can confirm the PDUs upon request from PMI!
Certifiaction Points
Organization: C421 - PMI Germany Chapter
Titel: Projektleitertreffen Hannover – Managing the quality of AI systems
PDUs: 0.5 Business Acumen, 1 Power Skills
A batch claim will be made by the PMI Local Group Hannover.
Take your chance and join in!
Want to make a contribution yourself?
Then get in touch with a topic. Anything is possible, from a lecture to a discussion round to an online workshop.
Write to us!
Your organizing team of Projektleitertreffen Hannover,
Marco Jacob, Marc Dürr, Andre Fuchs, Jörg Menke
Event Information
Event Date | 20.02.2025 18:30 |
Event End Date | 20.02.2025 20:00 |
Available Place | 94 |
Location | Online, Local Group Hannover |