Vaidy Krishnan

Incremental processing substantially reduces compute costs and execution time, leading to fewer failures and less manual intervention. However, enabling it on large-scale data workflows presents significant challenges around scalability, ease of adoption, and user experience.

Netflix operates a data lake of approximately one exabyte. Despite this, a portion of data (about 300 petabytes) remained in the legacy Apache Hive table format.

Twilio has democratized communications channels like voice, text, chat, video, and email by virtualizing the world’s communications infrastructure with APIs. Twilio’s business intelligence platform provides a 360-degree view of the business and is foundational to company-wide decision-making.