Olena Babenko

In normal situations, the default Kafka consumer and producer configuration options work well. But we all know life is not all roses and rainbows and in this session we’ll explore a few knobs that can save the day in atypical scenarios.

Data analysis and data pipelines for our event-driven applications both serve a common goal, but are often implemented independently. Data Scientists do the expert analysis using SQL requests to the data warehouse; later a Data Engineer transforms that into a fast, consistent and robust data pipeline written in code such as Java, Scala or Python.