Building Bulletproof AI Applications: Lessons from Processing Billions of Tokens Daily
Moderated the Slovenia AI Meetup featuring Tjaž Silovšek, CTO of Astra AI, who shared engineering realities of production AI systems handling provider outages, rate limits, and failures at scale.
Building reliable LLM applications means handling the cascade of failures that emerge at scale. This talk covered the engineering realities of production AI systems: provider outages, flaky connections, rate limits, and more. Drawing from hands-on experience processing billions of tokens daily, Tjaž Silovšek provided practical insights into creating robust, production-ready AI applications.
Event Details
Date: Thursday, October 9, 2025
Time: 6:00 PM - 8:00 PM CEST (Doors at 5:00 PM)
Location: Sportradar d.o.o., Litostrojska Cesta 52a, 1000 Ljubljana
Duration: 2 hours
About This Event
This event was ideal for engineers, developers, CTOs, and technical leads working with or planning to implement LLM-based applications in production environments.
Speaker
Tjaž Silovšek is the Chief Technology Officer at Astra AI, where he leads the development of large-scale AI systems. With extensive experience in building production AI applications, Tjaž has navigated the challenges of handling billions of tokens daily and has developed deep expertise in ensuring reliability and performance at scale.
Talk Topics
- Handling provider outages and service disruptions
- Managing rate limits and token quotas
- Building resilient retry mechanisms
- Monitoring and debugging production AI systems
- Ensuring reliability at scale
Agenda
17:00 - 18:00 - Doors open, networking
18:00 - 19:00 - Building Bulletproof AI Applications: Lessons from Processing Billions of Tokens Daily
19:00 - 20:00 - Q&A and networking
This event was organized by Slovenia AI Meetup and represents our commitment to bringing practical AI expertise to Slovenia’s growing tech community.