Tathagata Das

Marking its ninth anniversary this year, Delta Lake has grown significantly since its 2017 debut, spanning four major versions and 33 individual releases. As a premier ACID-compliant open table format globally, it sees 40M+ downloads per month and powers the daily processing of hundreds of exabytes of data. While the current roadmap includes the recent launch of Delta 4.3, the project is undergoing foundational shifts as it moves toward Delta 5.0. This session explores these paradigm shifts through two primary lenses: Evolution and Unification. Key topics will include: - The transition of Delta into a catalog-first table format. - Modernizing Delta on Spark by leveraging Data Source V2 APIs. - The convergence of the Delta and Iceberg formats. - Harmonizing the Delta Kernel across Java and Rust implementations.

The lakehouse is built for storage flexibility, but what about compute? In this session, we’ll explore how Unity Catalog enables you to connect and govern multiple compute engines across your data ecosystem. With open APIs and support for the Iceberg REST Catalog, UC lets you extend access to engines like Trino, DuckDB, and Flink while maintaining centralized security, lineage, and interoperability. We will show how you can get started today working with engines like Apache Spark and Starburst to read and write to UC managed tables with some exciting demos. Learn how to bring flexibility to your compute layer—without compromising control.

How to use UC OSS, what features are available, and intro to the ecosystem. We'll dive into the latest release and get hands-on with demos for working with your UC data and AI assets — including tables, volumes, models and AI functions.