Francisco Morillo

Unlock real-time streaming into Apache Iceberg with advanced performance tuning. Learn how to optimize ingestion pipelines using Apache Kafka and Apache Flink for fraud detection, IoT monitoring, and real-time analytics.

Streaming upserts into Apache Iceberg require careful tuning to avoid excessive delete files, small files, and commit overhead. In this hands-on workshop, participants will build and iteratively optimize streaming writes to Iceberg using Apache Flink.

Unlock the power of real-time data streaming into Apache Iceberg with advanced performance tuning techniques. In today's data-driven landscape, immediate insights are critical for fraud detection, IoT monitoring, and dynamic business intelligence.

With ever-growing data volumes and real-time requirements, tuning Apache Iceberg for performance while controlling costs can be challenging. This builders’ session dives deep into how Iceberg works, its configuration, advanced performance optimization options, and how to tune Iceberg for different workload patterns.

Prometheus is a de facto standard for monitoring and alerting, ingesting metrics from applications and infrastructure. The ability to efficiently store high volumes of dimensional time series also makes Prometheus a perfect fit for other operational analytics use cases, like observing fleets of IoT devices.

In today’s fast-paced business landscape, timely insights from data are crucial for organizations to remain competitive and responsive to dynamic market and customer demands. In this chalk talk, explore the competitive advantages of transitioning from traditional batch processing to stream processing.

Having multiple data silos causes data to be in different sources across the organization, which can make it difficult to perform analytics and democratize access to your data.