Mattias De Smet

Data movement and transformation workloads flow like threads through your new data platform. The bigger the platform becomes, the more of these threads appear and can either become entangled into a big knot or form a neatly woven robust piece of Fabric able to carry any load. This session presents Airflow as a professional solution to orchestrating Fabric data workloads. I describe the motivation behind this solution, the architecture of the system, and the integration of Airflow with Fabric. By building out a demo with real-world examples, we illustrate how this strategy addresses scalability, reliability, and operational challenges inherent in Fabric data workloads.