Marton Balassi

Reliable, self-service ingestion pipelines are at the core of any data streaming platform. Our approach based on Flink has three major novel aspects: Schema evolution including incompatible changes, Ingestion target is Apache Iceberg, Pipelines are managed via the Flink Kubernetes Operator.

In this interactive panel discussion, our panelists will be discussing best practices of running Flink SQL jobs reliably in production environments, its inherent challenges and pitfalls.

Cloudera’s Data-in-Motion team is adopting Flink to complete its platform for collecting, processing and analyzing event streams. In working with our customers we find that an increasing number of enterprises implement streaming first solutions, where insights are delivered in near real-time.