Huey Han

Cross-cloud and cross-region data sharing introduces egress costs that grow with recipient query volume, creating a scaling challenge for large-scale data providers. This session covers best practices for architecting cost-efficient OpenSharing deployments across clouds and regions, and introduces a new Databricks capability designed to change how providers manage cross-cloud/region delivery at scale.

As OpenSharing deployments scale to more recipients, managing per-recipient IP allowlists and allowing direct storage access becomes a significant operational burden. It can also be a blocker for data providers that want to keep their storage hidden behind firewalls. This session covers how OpenSharing SecureConnect addresses this problem by introducing a Databricks-managed network intermediary that proxies storage access on behalf of recipients. Providers perform a one-time network configuration regardless of the number of recipients. SecureConnect then handles routing across AWS, Azure, and GCP without requiring storage to be exposed to the public internet. We'll cover the architecture, cloud-specific configuration patterns, and how SecureConnect offers private and simple data sharing at scale.

Amazon S3 revolutionizes data discovery by automatically generating rich metadata for every object in your Amazon S3 buckets. Powered by Amazon S3 Tables, Amazon S3 Metadata provides a queryable metadata layer that allows you to curate, discover, and use your Amazon S3 data more efficiently.

Organizations are building petabyte-scale data lakes on AWS to democratize access to thousands of end users. In this session, learn about recent innovations in Amazon S3 that make it easier to build, secure, and manage your data lakes.

As enterprises become more data-driven, use cases for data proliferate and the data lake stack becomes more complex. This makes protecting data complex, costing organizations time and resources and adding unnecessary regulatory and compliance risk.

In this session, learn the best practices for configuring Amazon S3 Replication for regulatory compliance, security, and business continuity. Discover how S3 Replication can help you meet compliance requirements, minimize latency, increase operational efficiency, and maintain object copies under different ownership.

Amazon S3 Multi-Region Access Points provide a single global endpoint to access a dataset that spans multiple Amazon S3 buckets in different AWS Regions. This allows you to build multi-Region applications with the same simple architecture used in a single Region and run those applications anywhere in the world.