Michael Johnson

When you first begin tuning Spark performance, it can sometimes feel like a mix of trial and error, or simply scaling up resources until the job completes in the expected timeframe. This often leads to frustration and wasted resources.

The ‘UPSERT pattern’, where a set of data changes is combined with existing data, is a pattern commonly used in data engineering. The UPSERT pattern allows you, the data engineer, to merge INSERTS, UPDATES and DELETES.

Microsoft Fabric introduces a new storage format for Power BI which promises the performance of import mode with near real-time results all while removing the need for data refreshes. But is this the reality?

Microsoft Fabric offers a variety of data engineering solutions that can suit different needs and goals. However, this also means that choosing the right solution can be challenging and confusing for those who want to migrate to Microsoft Fabric.

Delta Lake is an exciting new file format that is being used by many of your big data analytics systems including both Databricks and Microsoft Fabric. Delta Lake brings many of the advantages of a relational database engine to a simple, open-source file format.

The ability to create and distribute content is undoubtedly one of Power BI's greatest strengths. However, this flexibility creates challenges for organisations that need added control, quality and reliability of the artefacts deployed to production.

Does your organisation need to manage the deployment of Power BI better? Join this session to learn how to shorten the time to deploy new features to your users while ensuring you maintain a standard for high quality using tools such as Azure DevOps and Power BI deployment Pipelines.

Data preparation is often the most labour-intensive component of any analytics project yet getting this right is vital if outcomes are to be accurate. While the growth of self-service BI empowers users to explore their data, the task of collecting and cleansing this data often requires more experienced hands.

Power BI Premium has many features that organisations desire yet the price makes it impractical for most. In this talk you will learn how Power BI Embedded can be used to enable many of these features at a much lower cost.