Arti Pande

John Deere manufacturing factories are equipped with thousands of state-of-the-art smart industrial robots and other machines. These next-gen factories are on a path to Industry 5.0 which requires equally advanced and well-integrated OT and IT systems to enable real-time availability and processing of OT data for faster decision making near the source of data in the factory and for improved overall operational efficiency in the organization. We present our Manufacturing IoT Edge platform, designed to fulfil the vision of Manufacturing 5.0, using open-source tools and standard protocols like MQTT, Sparkplug, Apache Kafka, Kafka Connect, Kafka Streams and more for collection, contextualization, stream processing, historization and analysis of manufacturing OT data in real-time. We cover technical details like core concepts of MQTT protocol with Sparkplug specification, how it is optimized for SCADA/IIoT solutions, how the Sparkplug data is processed using open-source Apache Kafka and ecosystem including custom-built Kafka Connectors for ingestion and stateful Kafka Streams processors. All the details we plan to present are relevant for building IoT Edge platforms for any other…

Real-time streaming applications in financial systems typically demand low-latency guarantee at very high throughput i.e. of the order of million transactions per second.