Indrajit Roy

The data world isn't slowing down—it’s streaming faster than ever. And if you're still thinking batch-first, it's time to flip the script. Join us for an overview of new features in Apache Spark™ Structured Streaming. Learn how it is enabling AI workloads for Cursor, machine learning workflows in Coinbase, and complex real-time requirements of MakeMyTrip. If you are an advanced user, this session is for you: we will showcase advanced features like real-time mode, transform with state, and streaming from hybrid sources. If you like simplicity, this session is also for you: you will discover how Spark Declarative Pipelines’s constructs can simplify stream processing.

This session is repeated.Is stream processing the future? We think so — and we’re building it with you using the latest capabilities in Apache Spark™ Structured Streaming. If you're a power user, this session is for you: we’ll demo new advanced features, from state transformations to real-time mode. If you prefer simplicity, this session is also for you: we’ll show how Lakeflow Declarative Pipelines simplifies managing streaming pipelines. And if you’re somewhere in between, we’ve got you covered — we’ll explain when to use your own streaming jobs versus Lakeflow Declarative Pipelines.