Alex Van Boxel

Let’s get the community in one room and discuss the future of Beam. What do you think what’s needed to make Beam a success? This forum will allow you to make a case for what you believe will be crucial. Submit your proposal for an item to discuss: https://forms.gle/2dQMowmbbTyW3SWC7. We will...

The OpenTelemetry Collector is a remarkable piece of software. It has a lot of parallels with a Beam pipeline, but it’s focused on processing and converting telemetry data. Due to its focus, it’s not designed to be run in batch and has limited functionality for parallelism. The ability to run...

At a certain time, when you’re a company that’s building out a successful SaaS platform there comes a time when classic observability tools don’t cut it anymore. Or they don’t scale as well as you grow or they become too expensive. That’s why the SRE team started to look at observability as a...

Apache Beam’s concept can sometimes be overwhelming. Sometimes is hard to see why something is designed the way it is. One of these concepts is the Combine function. This session takes a non-trivial data structure (the OpenTelemetry Exponential Histogram) as an example and goes through each step...

What up with all the metadata on the metadata? This deep dive into BIP-1, Beam Improvement Proposal One, tells the story about Schema Options. Schema Options give extra context to row fields and schemas. I’ll dive in the proposal and give a break down of the potential use, but I can already give...