Anthony Podgorsak

Lakeflow Jobs is the production-ready fully managed orchestrator for the entire Lakehouse with 99.95% uptime. Join us for a dive into how you can orchestrate your enterprise data operations, from triggering your jobs only when your data is ready to advanced control flow with conditionals, looping and job modularity — with demos! Attendees will gain practical insights into optimizing their data operations by orchestrating with Lakeflow Jobs: - New task types: Publish AI/BI Dashboards, push to Power BI or ingest with Lakeflow Connect - Advanced execution control: Reference SQL Task outputs, run partial DAGs and perform targeted backfills - Repair runs: Re-run failed pipelines with surgical precision using task-level repair - Control flow upgrades: Native for-each loops and conditional logic make DAGs more dynamic + expressive - Smarter triggers: Kick off jobs based on file arrival or Delta table changes, enabling responsive workflows - Code-first approach to pipeline orchestration

This session is repeated. Curious about orchestrating data pipelines on Databricks? Join us for an introduction to Lakeflow Jobs (formerly Databricks Workflows) — an easy-to-use orchestration service built into the Databricks Data Intelligence Platform. Lakeflow Jobs simplifies automating your data and AI workflows, from ETL pipelines to machine learning model training. In this beginner-friendly session, you'll learn how to: - Build and manage pipelines using a visual approach - Monitor workflows and rerun failures with repair runs - Automate tasks like publishing dashboards or ingesting data using Lakeflow Connect - Add smart triggers that respond to new files or table updates - Use built-in loops and conditions to reduce manual work and make workflows more dynamic We’ll walk through common use cases, share demos and offer tips to help you get started quickly. If you're new to orchestration or just getting started with Databricks, this session is for you.