Conferences / Airflow Summit
Airflow Summit 2023
Sep 19–21, 2023 · Toronto Marriott Downtown Eaton Centre, Toronto, ON, Canada
- Conference
- Airflow Summit Vendor & industry
- Dates
- Sep 19, 2023 – Sep 21, 2023
- Venue
- Toronto Marriott Downtown Eaton Centre
- Place
- Toronto, ON, Canada
- Format
- In person
- Status
- Past
- Attendance
- 510Organizer 2024 prospectus, 'Airflow Summit 2023 by the numbers': 510 in-person participants (92.15% turnout), 89 talks, 8 workshops, 122 speakers.
- Website
- airflowsummit.org
- Recorded
- 12 sponsors · 145 speaker appearances
- Notes
- First in-person-only edition. Sept 19-20 talks, Sept 21 workshop day. Conference ticket prices were sold via a Tito widget and are not archived; only the workshop-day price was found. Speakers: full list from the official session pages (source: site repo github.com/softwareguru/airflowsummit-website). Affiliations parsed from each speaker's site 'designation' as it stood in the repo shortly before the event; null where the designation names no company.
Ticket prices
| Ticket | Price | Valid until | Notes | Source |
|---|---|---|---|---|
| Workshop day (Sept 21) | $100 | — | Workshop ticket required for the workshop day. | airflowsummit.org |
Sponsors 12
Platinum 4
Community 1
- Packt · Partner
Other 4
- Kiwi.com · Diversity
- lakeFS · Diversity
- Preset · Diversity
- Unravel Data · Diversity
Speakers and talks 145
| Speaker | Company | Role | Talk | Links |
|---|---|---|---|---|
| Clayton Coleman | Keynote | AI/ML is Changing Orchestration: How Kubernetes can accelerate Airflow | Video | |
| Dustin Ingram | Python Software Foundation | Keynote | Open Source is Pretty Secure, Actually | Video |
| Julian LaNeve | Astronomer | Keynote | Building and deploying LLM applications with Apache Airflow | SlidesVideo |
| Kaxil Naik | Astronomer | Keynote | Building and deploying LLM applications with Apache Airflow | SlidesVideo |
| Rich Bowen | Apache Software Foundation | Keynote | Talking With Management About Open Source | SlidesVideo |
| Ahuitz Rojas | Akvelon | Talk | Delay Modeling and DAG Connectivity: Optimizing Airflow performance in large organizations | — |
| Akshay Battaje | Wealthsimple | Talk | Circumventing Airflow's Limitations around Multitenancy | Video |
| Alaeddine Maaoui | Société Générale | Talk | Airflow as a Data Hybrid Cloud Orchestrator | Video |
| Aldo Orozco Gomez | Etsy | Talk | Testing Airflow DAGs with Dagtest | SlidesVideo |
| Alina Aven | C2i Genomics | Talk | Platform for Genomic Processing Using Airflow and ECS | Video |
| Amit Kumar | GoDaddy | Talk | Airflow at GoDaddy: From on-prem to cloud to PaaS | — |
| Amogh Desai | Cloudera | Talk | Sketching Pipelines Using DAG Authoring UI | Video |
| Andrea Bombino | Astrafy | Talk | Data Product DAGs | Video |
| Aneel Murari | Amazon Web Services | Workshop | Performance optimize your Apache Airflow environment | — |
| Anthony Kalsatos | Wealthsimple | Talk | Circumventing Airflow's Limitations around Multitenancy | Video |
| Arun Joy Vattoly | Workshop | Lineage and Disaster Recovery procedures for Airflow based on Cloud Composer & Google Cloud Platform | — | |
| Ash Berlin-Taylor | Astronomer | Panel | The Faces of Airflow: A peek into the past and future | Video |
| Bartosz Jankiewicz | Talk | Traps and Misconceptions of Running Reliable Workloads in Apache Airflow | SlidesVideo | |
| Bartosz Jankiewicz | Workshop | Lineage and Disaster Recovery procedures for Airflow based on Cloud Composer & Google Cloud Platform | — | |
| Bas Harenslak | Astronomer | Talk | Event-based DAG Parsing: No more F5ing in the UI | SlidesVideo |
| Ben Chen | Vestiaire Collective | Talk | Unlocking the Power of Warehouse Allocation: Optimizing task dispatching for cost efficiency | SlidesVideo |
| Bolke de Bruin | — | Talk | Operators Need to Die | SlidesVideo |
| Branden West | Talk | Airflow at Reddit: How we migrated from Airflow 1 to Airflow 2 | SlidesVideo | |
| Brent Bovenzi | Astronomer | Talk | Future of the Airflow UI | SlidesVideo |
| C.J. Jameson | Monte Carlo | Talk | Data at Rest: Bringing granular quality into flowing pipelines | SlidesVideo |
| Christian Schilling | — | Talk | Flexible DAG Trigger Forms (AIP-50) | SlidesVideo |
| Daniel Imberman | Astronomer | Talk | To Debug a DAG: The Airflow local dev story | Video |
| Dave Milmont | Talk | Airflow at Reddit: How we migrated from Airflow 1 to Airflow 2 | SlidesVideo | |
| Dennis Ferruzzi | Amazon Web Services | Talk | Apache Airflow and OpenTelemetry | SlidesVideo |
| Diana Vazquez Romo | Bell Canada | Talk | From Bug To Bug Fix: Tips of how to submit an issue | Video |
| Diederik van Liere | Wealthsimple | Talk | Data about data: the case for a privacy centric schema language | Video |
| Dipankar Ghosal | Amazon Web Services | Talk | Migrate Apache Oozie Workflows to Airflow and Run with Amazon EMR | SlidesVideo |
| Ed Sparkes | Monzo | Talk | Airflow at Monzo: Evolving our data platform as the bank scales | SlidesVideo |
| Elad Kalif | Amazon Web Services | Workshop | Contributing to Apache Airflow | — |
| Eric Jones | IBM Databand | Workshop | Hands-on Data Observability with Airflow + Modern Data Stack | — |
| Filip Knapik | Sponsor talk | DAG Authoring without PhD, presented by Google Cloud | SlidesVideo | |
| Filip Knapik | Workshop | Lineage and Disaster Recovery procedures for Airflow based on Cloud Composer & Google Cloud Platform | — | |
| Filip Kunčar | Kiwi.com | Talk | Enabling Data Mesh by Moving from a Monolithic Airflow to Several Smaller Environments | SlidesVideo |
| Gabby Clavell | Bloomberg | Talk | Airflow at Bloomberg: Leveraging dynamic DAGs for data ingestion | SlidesVideo |
| George Yates | — | Workshop | Building an Airflow Pipeline with dbt and Snowflake | — |
| Han Gan | Snap Analytics | Talk | Airflow at Snap: Managing permissions, migrations and internal tools | SlidesVideo |
| Hoa Nguyen | — | Talk | Empowering Collaborative Data Workflows with Airflow and Cloud Services | SlidesVideo |
| Howard Yoo | — | Talk | Apache Airflow and OpenTelemetry | SlidesVideo |
| Hussein Awala | Leboncoin | Workshop | Contributing to Apache Airflow | — |
| Iddo Avneri | Treeverse | Talk | Supercharge Your Data Testing with a Fully Open Stack | SlidesVideo |
| Ivan Sayapin | Bloomberg | Talk | Airflow at Bloomberg: Leveraging dynamic DAGs for data ingestion | SlidesVideo |
| Jack Lockyer-Stevens | Ovo Energy | Talk | Chase The Sun: Build greener DAGs with VertFlow | Video |
| Jan Pawłowski | UniCredit | Talk | Airflow at UniCredit: Our journey from mainframe scheduling to modern data processing | SlidesVideo |
| Jarek Potiuk | — | Workshop | Contributing to Apache Airflow | — |
| Jarek Potiuk | — | Talk | Mastering Dependencies: The Airflow way | SlidesVideo |
| Jarek Potiuk | — | Talk | Multi-tenancy State of the Union | SlidesVideo |
| Jarek Potiuk | — | Panel | The Faces of Airflow: A peek into the past and future | Video |
| Jarek Potiuk | — | Panel | The Future of Airflow: What Users Want | Video |
| Jay Thomas | Qbiz | Talk | Simplifying the Creation of Data Science Pipelines with Airflow | Video |
| Jed Cunningham | Astronomer | Talk | Guided Tour to DAG Authoring | SlidesVideo |
| Jędrzej Matuszak | UniCredit | Talk | Airflow at UniCredit: Our journey from mainframe scheduling to modern data processing | SlidesVideo |
| Jens Scheffler | — | Talk | Flexible DAG Trigger Forms (AIP-50) | SlidesVideo |
| Jianlong Zhong | Coinbase | Talk | Airflow at Coinbase: How we supercharged the productivity of our users | — |
| Jilan Kothakota | Société Générale | Talk | Airflow as a Data Hybrid Cloud Orchestrator | Video |
| John Jackson | Amazon Web Services | Sponsor talk | Building a Commercial Service with Open-Source Community Focus, presented by AWS | — |
| John Jackson | Amazon Web Services | Panel | The Future of Airflow: What Users Want | Video |
| John Jackson | Amazon Web Services | Talk | Reducing Costs by Maximizing Airflow and DAG Performance | Video |
| Jonathan Leek | Astronomer | Talk | Building an Open Source Data Warehouse | — |
| Jonathan Rainer | Monzo | Talk | Airflow at Monzo: Evolving our data platform as the bank scales | SlidesVideo |
| Jonathan Talmi | Cohere | Talk | Manifest destiny: Orchestrating dbt using Airflow | Video |
| Jose Puertos | The Home Depot | Talk | Airflow at The Home Depot Canada: Observable orchestration platform for data integration and ML | — |
| Julien Le Dem | Astronomer | Talk | Nurturing an Open Source Community is Like Tending a Garden | SlidesVideo |
| Kaxil Naik | Astronomer | Talk | Introducing airflowctl: A CLI to streamline getting started with Airflow | Slides |
| Kaxil Naik | Astronomer | Panel | The Faces of Airflow: A peek into the past and future | Video |
| Kenten Danas | Astronomer | Talk | Supporting the Vast Airflow Community: Lessons learned from over 100 Airflow webinars | SlidesVideo |
| Kunal Haria | StyleSeat | Talk | Airflow at StyleSeat: Our journey, challenges & results | SlidesVideo |
| Kunal Jain | — | Talk | Cross Environment Event Based Triggers with Airflow | SlidesVideo |
| Laura Zdanski | Astronomer | Talk | Opportunities to join the Airflow (docs) community | — |
| Leah Cole | — | Workshop | Lineage and Disaster Recovery procedures for Airflow based on Cloud Composer & Google Cloud Platform | — |
| Luan Moreno Medeiros Maciel | — | Talk | A Single Pane of Glass on Airflow using Astro Python SDK, Snowflake, dbt, and Cosmos | Video |
| Luan Moreno Medeiros Maciel | — | Workshop | Developing Modern ETL Pipelines on Apache Airflow with Astro Python SDK | — |
| M. Waqas Shahid | Delivery Hero | Talk | Airflow at Delivery Hero: Running a data mesh with ~500 Airflow instances | Video |
| M. Waqas Shahid | Delivery Hero | Workshop | Airflow and Data Mesh: Architecture, setup & monitoring | — |
| Maciej Obuchowski | GetInData | Talk | OpenLineage in Airflow: A Comprehensive Guide | Video |
| Madison Swain-Bowden | Automattic | Talk | Forging the Future: Five years of fabricating with Airflow | SlidesVideo |
| Marc Lamberti | Astronomer | Panel | The Faces of Airflow: A peek into the past and future | Video |
| Marc Lamberti | Astronomer | Talk | What Everybody Ought to Know About Airflow | SlidesVideo |
| Marc Lamberti | Astronomer | Workshop | Get Airflow Certified | — |
| Mateusz Henc | Talk | Multi-tenancy State of the Union | SlidesVideo | |
| Mauricio De Diana | Monte Carlo | Talk | Data at Rest: Bringing granular quality into flowing pipelines | SlidesVideo |
| Maxime Beauchemin | Preset | Talk | Change Management Done Right Across Environments and Tools: DAGs, datasets and visualizations | Video |
| Michael Robinson | Astronomer | Talk | A New SQLAlchemyCollector and OpenLineageAdapter for Emitting Airflow Lineage Metadata as DAGs Run | SlidesVideo |
| Michał Modras | Workshop | Lineage and Disaster Recovery procedures for Airflow based on Cloud Composer & Google Cloud Platform | — | |
| Michał Modras | Talk | Airflow Driven Data Lineage In Public Cloud | SlidesVideo | |
| Nanxi Chen | Snap Analytics | Talk | Airflow at Snap: Managing permissions, migrations and internal tools | SlidesVideo |
| Nathan Hadfield | King | Talk | Eat, Sleep, Test, Repeat: How King ensures always-on data | SlidesVideo |
| Niko Oliveira | Amazon Web Services | Talk | My Journey to Committer Status: What I learned and how it can help you | SlidesVideo |
| Niko Oliveira | Amazon Web Services | Talk | Airflow Executors: Past, present and future | SlidesVideo |
| Pádraic Slattery | Xebia | Talk | Using Dynamic Task Mapping to Orchestrate dbt | Video |
| Parnab Basak | Amazon Web Services | Workshop | Performance optimize your Apache Airflow environment | — |
| Parnab Basak | Amazon Web Services | Talk | The Why and How of Running a Self-Managed Airflow on Kubernetes | SlidesVideo |
| Pete DeJoy | Astronomer | Talk | Things to Consider When Building an Airflow Service | SlidesVideo |
| Philippe Gagnon | Astronomer | Talk | An Introduction to Airflow Cluster Policies | SlidesVideo |
| Pierre Jeambrun | — | Panel | The Faces of Airflow: A peek into the past and future | Video |
| Rafal Biegacz | Workshop | Lineage and Disaster Recovery procedures for Airflow based on Cloud Composer & Google Cloud Platform | — | |
| Rafal Biegacz | Panel | The Future of Airflow: What Users Want | Video | |
| Rafal Biegacz | Sponsor talk | DAG Authoring without PhD, presented by Google Cloud | SlidesVideo | |
| Rafay Aleem | Faire | Talk | Airflow at Faire: Democratizing ML feature store framework at scale | SlidesVideo |
| Raj Ramalingam | Salesforce | Talk | Airflow at Salesforce: Building a fully managed workflow orchestration system | SlidesVideo |
| Rajesh Gundugollu | — | Talk | Airflow at Asurion: Simplified orchestration at petabyte scale | SlidesVideo |
| Ramajayam Gopithirumal | Cognizant | Talk | Migrating from Enterprise Scheduler like Autosys, TIDAL, Stonebranch to Airflow | — |
| Ramya Pappu | StyleSeat | Talk | Airflow at StyleSeat: Our journey, challenges & results | SlidesVideo |
| Raphaël Vandon | Amazon Web Services | Talk | DAG Parsing Optimizations | SlidesVideo |
| Rishi Kar | Snowflake | Workshop | Building an Airflow Pipeline with dbt and Snowflake | — |
| Ritika Jain | Twitch | Talk | Airflow at Twitch: Our recommendation system starring Airflow | Video |
| Roy Noyman | Wix.com | Talk | From Pain Points to Best Practices: Enhancing Airflow migrations and local development at Wix.com | Video |
| Russell Lamb | PepsiCo | Talk | Elevating Data Quality: Great Expectations and Airflow at PepsiCo | SlidesVideo |
| Ryan Delgado | Ramp | Talk | Better Airflow with Metaflow : A modern human-centric ML infrastructure stack | Video |
| Ryan Hatter | Astronomer | Talk | Beyond Data Engineering: Airflow for Operations | Video |
| Savin Goyal | Outerbounds | Talk | Better Airflow with Metaflow : A modern human-centric ML infrastructure stack | Video |
| Shirshanka Das | Acryl Data | Talk | How to use Data Contracts for Data Quality in your Airflow Ecosystem | Video |
| Shubham Mehta | Amazon Web Services | Talk | Demystifying Apache Airflow: Separating facts from fiction | Video |
| Shubham Raj | Cloudera | Talk | Sketching Pipelines Using DAG Authoring UI | Video |
| Soren Archibald | Qbiz | Talk | Simplifying the Creation of Data Science Pipelines with Airflow | Video |
| Stanislav Repka | Kiwi.com | Talk | Enabling Data Mesh by Moving from a Monolithic Airflow to Several Smaller Environments | SlidesVideo |
| Stanisław Smyl | New York Mets | Talk | Empowering Collaborative Data Workflows with Airflow and Cloud Services | SlidesVideo |
| Sung Yun | Bloomberg | Talk | Reliable Airflow DAG Design When Building a Time-Series Data Lakehouse | SlidesVideo |
| Syed Hussain | Amazon Web Services | Talk | Deferrable Operators | Video |
| Tatiana Al-Chueyr Martins | Astronomer | Workshop | Developing Modern ETL Pipelines on Apache Airflow with Astro Python SDK | — |
| Uma Ramadoss | Amazon Web Services | Talk | Demystifying Apache Airflow: Separating facts from fiction | Video |
| Utkarsh Sharma | Astronomer | Talk | Airflow: Under the hood | — |
| Varun Srinivas | Salesforce | Talk | Airflow at Salesforce: Building a fully managed workflow orchestration system | SlidesVideo |
| Victor Aoqui | Workshop | Lineage and Disaster Recovery procedures for Airflow based on Cloud Composer & Google Cloud Platform | — | |
| Victor Chiapaikeo | Etsy | Talk | Testing Airflow DAGs with Dagtest | SlidesVideo |
| Victoria Varney | Astronomer | Talk | Airflow at Faire: Democratizing ML feature store framework at scale | SlidesVideo |
| Vikram Koka | Astronomer | Sponsor talk | A Hypervisor for Airflow, presented by Astronomer | Video |
| Vikram Koka | Astronomer | Talk | Micropipelines: A microservice approach for DAG authoring using datasets | Video |
| Vincent Beck | Amazon Web Services | Talk | How to Build a System Test Dashboard and why you Should do it? | Slides |
| Vincent Beck | Amazon Web Services | Talk | Multi-tenancy State of the Union | SlidesVideo |
| Viraj Parekh | Astronomer | Sponsor talk | A Hypervisor for Airflow, presented by Astronomer | Video |
| Viraj Parekh | Astronomer | Panel | The Future of Airflow: What Users Want | Video |
| Viraj Parekh | Astronomer | Talk | Things to Consider When Building an Airflow Service | SlidesVideo |
| Vladi Nekolov | Financial Times | Talk | Accelerating Data Delivery: How the FT automated its ETL pipelines with Airflow | SlidesVideo |
| Wanda Kinasih | Gojek | Talk | Airflow at Gojek: Streamlining data processing for Tableau dashboards | SlidesVideo |
| Xiaodong Deng | Apple | Talk | Better Support for Using Multiple Namespaces with KubernetesExecutor | SlidesVideo |
| Yuri Desyatnik | Snap Analytics | Talk | Airflow at Snap: Managing permissions, migrations and internal tools | SlidesVideo |
| Zachary Bannor | Conde Nast | Talk | Reducing Cost with Async/Deferrable Operators | — |
| Zdravko Hvarlingov | Financial Times | Talk | Accelerating Data Delivery: How the FT automated its ETL pipelines with Airflow | SlidesVideo |
| Zhengyi Liu | Snap Analytics | Talk | Airflow at Snap: Managing permissions, migrations and internal tools | SlidesVideo |
| Zohar Donenhirsh | C2i Genomics | Talk | Platform for Genomic Processing Using Airflow and ECS | Video |