API World + CloudX + Dev Innovation Summit 2024

Gaganjot Kaur Kang, Sony PlayStation, Senior Software Engineer

This session is designed to provide a comprehensive framework for developing real-time data analytics and data processing pipelines and to explore the cloud-based technologies that facilitate this process like AWS Timestream, and AWS S3. The agenda includes:

- An overview of the general architecture of real-time event processing systems
- The role and importance of technologies such as Apache Kafka, Apache Flink, AWS Timestream, AWS S3, and others in this architecture
- Addressing challenges in data processing, including state management, event-time handling, and job monitoring
- Real-world applications, such as metric aggregation over a time window and real-time computation of product prices and discounts