How we test AI bots on made-up customers
About the webinar
AI bots look great in demos but make mistakes with real people. We built a test bench called Poligon, where made-up customers message the bot the way real people do. They send messages in fragments, make typos, and change their minds. We judge the result by what the bot actually recorded in the system, not by what it replied.
What we'll show
- How Poligon works. Code-based checks, a jury of three models from different vendors, and disputed cases.
- Live demo. Our Slack bot for vacation requests passes only 3 of 9 scenarios with a real employee because it loses the conversation context. We'll show how we're fixing it.
- Approaches from our projects. Expert reference answers, tests on real product tasks, and checks against random guessing.
Who it's for
Teams launching or already running AI bots in support, sales, appointment booking, and internal services. Product managers, QA engineers, developers, and founders.
Want to test your own bot? At the end of the webinar, you can discuss a free test with the speaker in exchange for feedback.
Speaker: Vladislav Kovalsky, AI Systems Architect, SpurIT
Format: online, 60–90 minutes.
Date and time: Tuesday, October 27, 7:00 PM Astana time (UTC+5).