Noritaka Sekiyama

In modern data architectures, Apache Iceberg has become a popular table format for data lakes. Iceberg evolves at a rapid pace, and one of the recent key enhancements is Apache Iceberg V3 format.

As organizations increasingly adopt modern data stacks, the combination of dbt and AWS Analytics services emerged as a powerful pairing for analytics engineering at scale.

This chalk talk explores architectural patterns that can elevate data management capabilities of an Apache Iceberg data lake including the write-audit-publish (WAP) pattern for ensuring data quality, the slowly changing dimensions (SCD) Type 2 pattern for tracking historical data changes, and the change log view…

Traditional data integration and transformation tools are expensive and piecemeal, pushing organizations toward a multi-tool approach to deliver on functions such as ETL, discovery, movement, cleansing, transformation, and cataloging.

AWS Glue is a serverless data integration service that makes it easier to discover, prepare, move, and integrate data from multiple sources. Attend this session and learn ways that AWS Glue can simplify how you create and manage your data pipelines.

In this chalk talk, learn how AWS serverless offerings can help you implement your Apache Spark workloads without worrying about the underlying infrastructure. Explore different Spark use cases and the available options to run these workloads with AWS analytics services.