Conferences / Beam Summit
Beam Summit 2024
Sep 4–5, 2024 · Google campus, building MP-6, Sunnyvale, CA, United States
- Conference
- Beam Summit Database
- Dates
- Sep 4, 2024 – Sep 5, 2024
- Venue
- Google campus, building MP-6
- Place
- Sunnyvale, CA, United States
- Format
- In person
- Status
- Past
- Attendance
- —Apache Beam blog: 47 talks; speakers and attendees from 23 countries. No headcount.
- Website
- beamsummit.org
- Recorded
- 5 sponsors · 55 speaker appearances
- Notes
- 7th edition per organizer. In person only. Full session list from beamsummit.org/sessions/2024/. Affiliations come from beamsummit.org speaker pages, which hold one (possibly later) bio per person, so a few may be out of date for this year.
Ticket prices
| Ticket | Price | Valid until | Notes | Source |
|---|---|---|---|---|
| In-person (free) | $0 | — | FAQ: Beam Summit is free | web.archive.org |
Sponsors 5
Platinum 1
Community 4
- Apache Software Foundation · Community Partners
- Clowder · Community Partners
- MavenCode · Community Partners
- Osacom · Community Partners
Speakers and talks 55
| Speaker | Company | Role | Talk | Links |
|---|---|---|---|---|
| Ahmed Abualsaud | Speaker | Breaking the Language Barrier: Easy Cross-Language with Generated Python Wrappers | Slides | |
| Alberto López Serna | — | Speaker | Avoid HTTP Request Duplicates with SCIO, a custom AsyncHttpParDoFn and State & Timers | SlidesVideo |
| Alberto López Serna | — | Speaker | Drools ParDo and SCIO: a goodbye microservices tale | Slides |
| Arwin Tio | Cruise | Speaker | Scaling Autonomous Driving with Apache Beam | Slides |
| Austin Bennett | Bamboozoology | Speaker | Beam YAML and Protobuf | SlidesVideo |
| Ayush Pandey | University of Colorado Boulder | Speaker | RAG Data Ingestion and Enrichment Pipeline using Redis and OpenSearch Vector Database in Apache Beam | SlidesVideo |
| Baojun Liu | Uber | Speaker | Transitioning Uber Michelangelo's Batch Prediction from Apache Spark to Ray | SlidesVideo |
| Bipin Upadhyaya | — | Speaker | Accelerating CDC Data Ingestion with Apache Beam: A Qlik-to-BigQuery Journey | Slides |
| Byron Ellis | Speaker | Implementing a Beam SDK: A Deep Dive into the Swift SDK | SlidesVideo | |
| Charles Adetiloye | MavenCode | Speaker | A Low Code Structured Approach to Deploying Apache Beam ML Workloads on Kubernetes using BeamStack | Slides |
| Damon Douglas | Speaker | Processing Data from a Web API: A step by step guide | SlidesVideo | |
| Danny McCormick | Speaker | How Beam ML Optimizes Serving Large Models | SlidesVideo | |
| Ferran Fernandez | Chartboost | Speaker | Beam YAML and Protobuf | SlidesVideo |
| Hai Sadon | Transmit Security | Speaker | Real-Time Fraud Prevention with Apache Beam | Slides |
| Ihaffa Murtopo | Speaker | At Least Once Streaming vs Exactly Once: Cost saving vs data accuracy | SlidesVideo | |
| Iris Luden | ML6 | Speaker | Multi-Modal LLM Data Processing with Apache Beam | SlidesVideo |
| Jack McCluskey | Speaker | Using LLMs with Beam and RunInference | Slides | |
| Jasper Van den Bossche | ML6 | Speaker | RAG Data Ingestion Using Apache Beam | SlidesVideo |
| Jasper Van den Bossche | ML6 | Speaker | Multi-Modal LLM Data Processing with Apache Beam | SlidesVideo |
| Jeff Kinard | Speaker | Beam YAML: Advanced topics | SlidesVideo | |
| Jeff Kinard | Speaker | Introduction to Beam YAML | SlidesVideo | |
| Jinjing Bi | Speaker | Usage Billing with BEAM @ LinkedIn | SlidesVideo | |
| John Casey | Speaker | Using Dead Letter Queues with Beam | SlidesVideo | |
| Konstantin Buschmeier | ML6 | Speaker | RAG Data Ingestion Using Apache Beam | SlidesVideo |
| Konstantin Buschmeier | ML6 | Speaker | Multi-Modal LLM Data Processing with Apache Beam | SlidesVideo |
| Lakshmanan Arumugam | Recursion | Speaker | How we Migrated our JSON DB to a Relational DB using Apache Beam / Dataflow | SlidesVideo |
| Lydian Lee | Affirm | Speaker | Improving Stability for Running Python SDK with Flink Runner | SlidesVideo |
| Marc Howard | Speaker | Project Shield: How we use Beam to defend democracy and free expression, and how we got started! | SlidesVideo | |
| Matt Mays | Solace | Speaker | The SolaceIO connector: how was it made and why | Slides |
| Namita Sharma | Speaker | Streaming Processing for RAG Architectures | SlidesVideo | |
| Narayanan Venkiteswaran | — | Speaker | Usage Billing with BEAM @ LinkedIn | SlidesVideo |
| Nate Salawe | MavenCode | Speaker | A Low Code Structured Approach to Deploying Apache Beam ML Workloads on Kubernetes using BeamStack | Slides |
| Olu Akinlaja | DoiT | Speaker | using pub/subIO writeMessageDynamic() function in a Python pipeline to use dynamic topic destination | SlidesVideo |
| Olufunbi Babalola | MavenCode | Speaker | BeamStack: An open source Framework for running Machine Learning Pipelines with Apache Beam | SlidesVideo |
| Pablo Rodriguez Defino | Speaker | Streaming Processing for RAG Architectures | SlidesVideo | |
| Prakash Chockalingam | Speaker | Lessons Learned from MLOps for GenAI at Google Scale | SlidesVideo | |
| Rajkumar Gupta | Speaker | Troubleshooting Beam/Dataflow ML Pipelines Related Common Issues | SlidesVideo | |
| Ravi Magham | Lyft | Speaker | Realtime Forecasting using Beam | SlidesVideo |
| Reza Rokni | Speaker | Using LLMs with Beam and RunInference | Slides | |
| Robert Burke | — | Speaker | A New Local Runner Appears: Deep dive on Prism | SlidesVideo |
| Robert Burke | — | Speaker | Beam SDKs Don't Have to Look the Same | SlidesVideo |
| Rohit Sinha | Speaker | Data Lineage in Beam | SlidesVideo | |
| Sadeeq Akintola | Speaker | Reuniting the Two Distant Cousins: Calling a Beam Pipeline from an Airflow Job | SlidesVideo | |
| Sayat Satybaldiyev | — | Speaker | Scaling Autonomous Driving with Apache Beam | Slides |
| Sergei Lilichenko | Speaker | Ordered processing in Apache Beam | SlidesVideo | |
| Sergei Lilichenko | Speaker | Cost Optimization of Dataflow Pipelines | SlidesVideo | |
| Sharan Teja Malyala | Speaker | Cost Effective Solutions for Beam pipelines in Dataflow | SlidesVideo | |
| Shunping Huang | Speaker | Introducing Ordered List States | SlidesVideo | |
| Surjit Singh | Speaker | Dataflow CI/CD | SlidesVideo | |
| Tom Stepp | Speaker | Dataflow Streaming: The evolution of real-time data processing | SlidesVideo | |
| Uday Kalra | Speaker | Beam for Large-Scale, Accelerated ML Inference at Google | SlidesVideo | |
| Valentyn Tymofieiev | Speaker | Troubleshooting Python pipelines with process monitoring tools. | SlidesVideo | |
| Wei Hsia | Workshop | Workshop: Multiple Input, Multiple output, Multi-Modal Inference: Streaming ML with Dataflow | — | |
| Yasmeen Ahmad | Speaker | Innovating the Data & AI Platform | Video | |
| Yi Hu | Speaker | Throttling Detection and Reactive Worker Downscaling | SlidesVideo |