Data Conference Databasea Query.Farm index
Speakers

Huichao Zhao

Employers on the program

  1. 2024Apple2 talks
Events1
Conferences1
Talks2
Years active2024

Appearances by year

201920202021202220232024202520262027
  • Community Over Code (formerly ApacheCon)

Talks

DateEventConferenceRoleTitleLinks
Oct 7, 2024Community Over Code North America 2024Community Over Code (formerly ApacheCon)speakerBuilding Reliable Cloud Native Data Processing Platform with Apache Spark and Cloud Shuffle Manager
as Apple
Apache Spark, a cornerstone in large-scale data processing, faces challenges in fault tolerance when running on Kubernetes, especially in environment like…Show less

Apache Spark, a cornerstone in large-scale data processing, faces challenges in fault tolerance when running on Kubernetes, especially in environment like shared cluster or with Spot virtual machines, where shuffle data are vulnerable to underlying infrastructure instabilities. To make Spark super reliable and also leverage Spot Instance/VM to save cost, we built a new Shuffle Manager to store shu

Oct 7, 2024Community Over Code North America 2024Community Over Code (formerly ApacheCon)speakerEfficient Autoscaling for Spark on Kubernetes using Karpenter
as Apple
Cost savings consistently ranks among the top priorities for anyone operating a cloud platform on Kubernetes. Batch processing workloads are especially amenable…Show less

Cost savings consistently ranks among the top priorities for anyone operating a cloud platform on Kubernetes. Batch processing workloads are especially amenable to an effective cost saving technique that is autoscaling.

Frequent co-speakers

SpeakerShared eventsShared talksLast together
Chaoran Yu112024
Jiale Tan112024

Speakers with the same name are merged into one entry, so this page may combine more than one person. Affiliations are shown as each conference listed them.