Data Conference Databasea Query.Farm index
Speakers

Davis Wertheimer

Employers on the program

  1. 2023IBM1 talk
Events1
Conferences1
Talks1
Years active2023

Appearances by year

201920202021202220232024202520262027
  • PyTorch Conference

Talks

DateEventConferenceRoleTitleLinks
Oct 16, 2023PyTorch Conference 2023PyTorch ConferencespeakerLessons Learned in WatsonX Training: Scaling Cloud-Native PyTorch FSDP to 20B Parameters
as IBM
In this talk we will cover lessons learned along our almost year-and-a-half journey scaling up the WatsonX.AI stack for foundation model pretraining. Starting…Show less

In this talk we will cover lessons learned along our almost year-and-a-half journey scaling up the WatsonX.AI stack for foundation model pretraining. Starting from 100M parameters on bare metal, we scaled PyTorch training to 20B parameters on cloud-based multi-node systems. We'll discuss the...

Frequent co-speakers

SpeakerShared eventsShared talksLast together
Supriyo Chakraborty112023

Speakers with the same name are merged into one entry, so this page may combine more than one person. Affiliations are shown as each conference listed them.