Tomasz Kostyrka

We’ll explore query optimization techniques from B-Trees, through Z-Order and Liquid Clustering, to V-Order, diving into their mathematical foundations, challenging our intuition, and uncovering the mechanisms driving their performance.

In this session, we will walk through the main optimization techniques - starting with classic indexes (B-Tree) for relational databases, via Z-Order, and Liquid Clustering for Lakehouses, and ending with the V-Order mechanism, recently introduced by Microsoft. We will delve into the mathematical foundations behind the mechanisms to fill in some gaps and mention concepts that are often overlooked

During this session, we'll dive into building a production-ready flow for dbt projects on Databricks and Microsoft Fabric. We'll start with a brief introduction to what Analytics Engineering is, why the ELT approach is dominating platforms like Databricks, Snowflake, and MS Fabric right now, and how dbt helps us…

Cel warsztatu: Celem warsztatu jest przekazanie uczestnikom praktycznej wiedzy i umiejętności w zakresie budowy i wdrażania potoków danych za pomocą narzędzia dbt. Uczestnicy poznają miejsce dbt w procesie ELT, nauczą się konfiguracji projektów, pracy z modelami oraz testowania jakości danych.

During this session, we'll dive into building a production-ready flow for dbt projects on Databricks and Microsoft Fabric. We'll start with a brief introduction to what Analytics Engineering is, why the ELT approach is dominating platforms like Databricks, Snowflake, and MS Fabric right now, and how dbt helps us…

Azure Data Platform as Code - can it be done it in less than a week? At the beginning of 2023, an idea came to mind: let's check if we can prepare the entire data platform as code and install it straight out of the box on a fresh and clean Azure environment.

The aim of this session is to demonstrate how an enterprise-ready Azure Data Platform can be set up from scratch in days instead of months. I will present the most important lessons I've learned over the last year while working on such an automation framework.