Mazlum Tosun

The goal of this talk is to show a real-world and full Beam pipeline with Kotlin and Midgard library. This library was created recently to help Beam and Kotlin communities to have a more concise/expressive code and a more functional programming style. Kotlin is a great language and we love using...

The goal of this talk is showing a full example with a CI CD pipeline for Dataflow jobs. The jobs will be based on Flex Template that is a way to standardize the deployment of Dataflow jobs and we are going to show a full example with Java and Python SDKs. The CI CD will be orchestrated with...

I created a library for error handling with Apache Beam Java and Kotlin. Asgarde allows error handling with less code and more concise/expressive code. The purpose is showing Beam native error handling, and the same with Asgarde Java. I will also show Asgarde Kotlin with even more concise code...

In my previous customer, we did a code migration from Spark/Dataproc et Apache Beam/Dataflow. I proposed an hexagonal architecture + Domain driven design with Apache Beam, in order to isolate to business code (bounded context/domain) and technical code (infrastucture). This architecture is used...