Dave Ruijter

Join us on a technical journey into GreenOps at ABN AMRO Bank using Databricks system tables. We'll explore security, implementation challenges and best-practice verification, with practical examples and actionable reports. Discover how to optimize resource usage, ensure compliance and maintain agility. We'll discuss best practices, potential pitfalls and the nuanced 'it depends' scenarios, offering a comprehensive guide for intermediate to advanced practitioners.

Embark on a journey through the dynamic realm of Feature Stores. Learn how they streamline data processes for ML projects, acting as the control tower for feature management.

Join us and learn how to build a unified overview on essential information regarding pipelines, performance, data quality, user activity, cost management, and much more. Shared to all stakeholders in a Power BI dataset and report. We'll share our learnings and best-practices along the way in a...

In this demo-rich session you will learn how you can implement a framework for data quality validation and monitoring, spanning your end-to-end data platform including Power BI!

Do you know your data? And do you already actively monitor for deviations from those expectations? Being in control of your data quality is essential for any solution, whether it's running in Azure Databricks, Azure Synapse Analytics or Power BI. In this demo-rich session you will learn how you can implement a framework for data validation and monitoring, spanning your end-to-end data platform including Power BI! We'll leverage an open source library called great-expectations to quickly get up-and-running. With the demonstrations, practical tips and example scripts, you will be able to implement this framework in your own data platform and solutions. Become in control of the data quality of your solutions!

For Power BI solutions, we see it can be challenging to load data from APIs, or to store historical snapshots. This is where you can really benefit from the capabillities of a data platform. Also, if you already have an amazing data platform, we see it can be challenging to load all of its data into a Power BI dataset and still have a performant solution, or to refresh data in near real-time. Finally, daisy-chaining all the steps in the data flow – from source to report/dashboard – can be tricky to design, especially if you don’t want to do a full refresh of the Power BI dataset for performance reasons. The advanced capabilties of both worlds can really complement eachother. Learn how to design and build a truly scalable solution that spans both Power BI and Azure Synapse Analytics. We will help you to get the best out of both worlds, sharing our learnings and best-practices along the way in a demo-rich session! After the session you will be able to: • Better design and implement complex data models, including hybrid tables, aggregations, and combined storage modes (import, DirectQuery, dual). • Orchestrate the end-to-end data processing, with a pipeline chain from data ingest in the data lakehouse to the incremental Power BI dataset refresh. • Use different techniques to identify performance bottlenecks in your solutions and how to solve those ("does it fold"?). • Implement a cost-efficient solution, that still meets the scalability demands.

Are you planning a migrating of your data platform to Azure Synapse Analytics? Is it currently based on Azure Databricks, Azure Data Factory, and Azure Data Lake Storage? Make sure to grab these 10 tips! We'll talk about Spark compatibilities, orchestration pitfalls and solution deployment...

Have you had that moment, where you arr in doubt which Azure service to use for your 'Modern Data Warehousing' solution? So many good options.. Like the Mapping/Wrangling Data Flows capabilities in Azure Data Factory, or the Delta feature in Databricks! In this session we will take a look at the different services, compare them using real use-cases, and learn how to choose the best fit for each scenario.

In this demo-rich session, Dave & Marc discuss the Power BI Cheat Sheet that went viral on social media. The sheet is crammed with Power BI tips and best practices based on years of experience, but with little to no room for comments. No worries! We will describe, demonstrate and discuss all the items! And of course, there will be a Cheat Sheet for everyone attending!