Bart Samwel

When a region goes down, every minute counts. Until now, achieving disaster recovery on a lakehouse meant stitching together brittle, DIY replication pipelines metadata, data, and workspace assets. Today, we're changing that. Managed Disaster Recovery brings turnkey, cross-region resilience to the Databricks Lakehouse. In this session, we'll introduce for the first time Databricks' Managed Disaster Recovery offering. We'll cover: - The architecture: how UC replication, data replication, and workspace asset replication work together under one unified API to deliver 15-minute RPO and RTO targets - What gets replicated — and what we learned building DR for managed tables, Managed Iceberg, and workspace assets at scale - Live demo: we'll create a failover group, watch replication in action, trigger a forced failover, and show applications seamlessly reconnecting through Stable URLs — all in real time Whether you're in financial services with strict RTO mandates, running mission-critical ML pipelines, or simply tired of the "what's our DR plan?" question having no good answer, this session will show you how to go from unprotected to fully resilient in minutes — not months.

In this session, learn about why modern open table formats like Delta and Iceberg are a big deal and how they work with catalogs. Learn about what motivated their creation, how they work, what benefits they can bring to your data and AI platform. Hear about how these formats are becoming increasingly interoperable and what our vision is for their future.

Dynamic Insert Overwrite is an important Delta Lake feature that allows fine-grained updates by selectively overwriting specific rows, eliminating the need for full-table rewrites. For examples, this capability is essential for: - DBT-Databricks' incremental models/workloads, enabling efficient data transformations by processing only new or updated records - ETL Slowly Changing Dimension (SCD) Type 2 In this lightning talk, we will: - Introduce Dynamic Insert Overwrite: Understand its functionality and how it works - Explore key use cases: Learn how it optimizes performance and reduces costs - Share best practices: Discover practical tips for leveraging this feature on Databricks, including on the cutting-edge Serverless SQL Warehouses