Michiel Van Nijverseel

Do you think you know Databricks? Let’s put that to the test. Are these statements true or false? "Partitioning your data is almost never a good idea." "DBUs and VM costs are the main drivers of your total Databricks spend." "Once you use managed tables, you are locked in into Databricks" If you're not 100% sure, this session is for you. We'll walk through 10 of the most common misconceptions in Databricks - covering topics like table maintenance, cluster configuration, data structure design, performance optimization, cost management, and more. Expect practical insights, real-world examples, and yes - there will be a quiz!

Join this engaging session as we delve into the critical role of query performance in the world of Data Lakehouses. While cloud-based data lake storage offers cost-efficiency, it often falls short in terms of performance. Fortunately, Databricks has developed a groundbreaking solution: Delta Lake. To highlight the relevancy of this topic, solutions like Fabric have also recognized the immense value of Delta Lake and implemented it within their framework. In this inclusive session, we will explore the mechanics of working with tables in the Delta format. Through captivating demos, you'll witness firsthand the seamless integration and functionality of Delta Lake. We'll delve into the hidden intricacies and demonstrate the need for optimization, empowering you to unlock the full potential of Delta Lake. But optimization is the key to truly unleashing the power of Delta Lake. We'll showcase impactful optimization techniques through practical demos, allowing you to supercharge your Data Lakehouse. From intelligent partitioning to efficient data indexing, these demos will provide valuable insights to maximize query performance and accelerate your data analytics processes. Join us on this collective journey to witness the mechanics and optimization of Delta Lake in action. Discover the art of optimization and unlock the true potential of your data-driven endeavors. Get ready to elevate your data analytics game as we embark on a hands-on exploration of the power of Delta Lake!