Grace O'Halloran

These days, most people want their Azure Data Platforms to be deployed in a secure a network topology. As Data Engineers, we are often the ones that have the make this happen.

These days, most people want their Azure Data Platforms to be deployed in a secure a network topology. As Data Engineers, we are often the ones that have the make this happen. The cloud has made it easy for us to deploy a virtual network here and a private endpoint there, but what does a good, networked data platform actually look like, and how does it work? Simple things become complex: how will my ADF Integration Runtime talk to my data sources? How do I securely access my resources to do development? In this session we will look at some of the core network components which can be used to secure your data platform; what they are, and how to use them effectively. We will also look at some of the decisions that need to be made when moving your data platform inside a private network, which weren't a consideration previously. Some basic knowledge of what a virtual network is is required. By the end of this session you should feel more confident in working with network components in Azure and how you can use them to secure your Data Platform.

Ben and Rob have found some wonderful folk to actually do the important parts of the community keynote. on the theme of How to be a nonpassive member of the data community

Moving data from A to B has been made easy through the use of integration tools such as Azure Data Factory and Azure Synapse Pipelines, but when you’re working inside a highly secured environment, the reference architecture quickly goes out the window. How do you enable secure data movement into your data platform? How do you easily move data around in private networks? Azure provides many options beyond the default Azure-hosted Integration Runtime but which one is right and how do we set them up? In this talk I will explore how the different types of Data Factory and Synapse Integration Runtimes can be used to access and transfer data in a secure network topology. I will discuss some common secure architectures and explain how Integration Runtimes can fit into these designs to facilitate simple yet secure data integration.