David Kjerrumgaard

Open table formats like Apache Iceberg have become the backbone of the lakehouse, but streaming data still arrives with fragmented metadata and governance: topics live in messaging systems, schemas live in registries, and tables live in catalogs—often stitched together by connectors and convention. In this talk, we propose a Streaming Data Catalog pattern for the Iceberg ecosystem: a metadata lay

Discover a groundbreaking integrated data streaming platform that seamlessly merges Apache Pulsar's limitless storage scalability with Apache Flink's real-time processing prowess.

In recent years, event-driven architecture (EDA) has been popular for building real-time and scalable applications. Apache Pulsar is a distributed pub-sub messaging system designed for building EDA applications. In this talk, we will explore how Apache Pulsar can be used to build scalable and resili

Apache Pulsar is a next-generation distributed messaging and streaming platform gaining popularity due to its unique multi-protocol capability. Unlike traditional messaging systems that typically support a single messaging protocol, Apache Pulsar is designed to provide seamless support for multiple

In many use cases, applications are using Pulsar consumers or readers to fetch all the updates from a topic and construct a map with the latest value of each key for the messages that were received.The new TableView consumer offers support for this access pattern directly in the Pulsar client API it

Starting with version 2.10, the Apache ZooKeeper dependency has been eliminated and been replaced with a pluggable framework that enables you to reduce the infrastructure footprint of Apache Pulsar by leveraging alternative metadata and coordination systems based upon your deployment environment.In

The business value of data decreases rapidly after it is created, particularly in use cases such as fraud prevention, cybersecurity, and real-time system monitoring.