Kamil Nowinski

Declarative Automation Bundles (DABs, previously known as Databricks Asset Bundles) bring an "infrastructure-as-code" approach to packaging and deploying notebooks, jobs, pipelines, and workflows across environments. Instead of clicking through the workspace UI or stitching together ad-hoc scripts, teams can define…

In this session, Kamil, a seasoned data engineer with over two decades of expertise in data (SQL Server, Azure SQL, and now Fabric), shares his view on the new database capabilities in Microsoft Fabric. In this session, you will learn enough about Fabric and SQL database (not Warehouse) concepts to start building your…

In this session, you will learn enough about Fabric and SQL database (new database capabilities - not Warehouse) concepts to start building your own solutions immediately. The session starts with a few theoretical concepts to provide guidelines and is then filled with practical examples. We will go through everything important when it comes to SQL Database: managing objects from UI, syncing code with Git, developing code with VSCode, using built-in Graph API for applications and also deploying to other environments. During the session, we will think about what typical scenarios or use cases might be used together with SQL Database in Fabric.

W świecie dynamicznie zmieniających się danych kluczowym wyzwaniem staje się efektywne i automatyczne przetwarzanie informacji w czasie rzeczywistym. Podczas tej sesji pokażemy, jak na platformie Microsoft Fabric zintegrować architektury lakehouse i przetwarzania czasu rzeczywistego, wykorzystując takie…

There are more and more file formats nowadays: Parquet format is not the best shiny star any longer. Now, the Delta Lake takes the prim. Why people do confuse it with Parquet and always talk about files in this case? In this session, we'll take a look at the evolution of ETL into ELT and its storage aspect, which explain why it is "a must" for modern data warehouse solutions and how is it related Delta Lake technology in cloud environments like Databricks or Synapse Analytics. Finally, we'll check what's Delta-Parquet creature presented in Microsoft Fabric OneLake recently. We will see also what data layers (stages) are commonly set up and why they make sense.

ADF is an important brick in the architecture of any modern data warehousing solution and many other scenarios. As it exists for some time now and we know its capability pretty well, the deployment of the service is still something that leaves much to be desired, specifically in a bit more complex instances.

ADF is an important brick in the architecture of any modern data warehousing solution and many other scenarios. As it exists for some time now and we know its capability pretty well, the deployment of the service is still something that leaves much to be desired, specifically in a bit more complex instances.

Microsoft's services in Azure helps us to leverage big data more easily and even more often accessible for non-technical users. Having UI in ADF version 2 - Microsoft added a new feature: Mapping Data Flow which resembles components of SSIS.

We will review this new feature of ADFv2, do deep dive to understand the mentioned techniques, compare them to SSIS and/or T-SQL and learn how modelled data flow runs Scala behind the scenes.