John Casey

In this session, you will learn what we consider a Dead Letter in Beam, the high level DLQ architecture we’ve implemented, and some example use cases on how to incorporate DLQs in your pipelines.

Writing an IO in Beam is hard. Distributed data reading and writing are inherently challenging, and its easy to make mistakes. This session is a walk through on the key design hurdles, and how to use Beam features to write a high quality IO.