Ye (Charlotte) Qi
Employers on the program
- 2024Meta1 talk
Events1
Conferences1
Talks1
Years active2024
Appearances by year
- QCon
Talks
| Date | Event | Conference | Role | Title | Links |
|---|---|---|---|---|---|
| Nov 18, 2024 | QCon San Francisco 2024 | QCon | speaker | Scaling Large Language Model Serving Infrastructure at Meta as Meta Platform, Inc. Running LLMs requires significant computational power, which scales with model size and context length. We will discuss strategies for fitting models to various…Show lessRunning LLMs requires significant computational power, which scales with model size and context length. We will discuss strategies for fitting models to various hardware configurations and share techniques for optimizing inference latency and throughput at Meta. |
Frequent co-speakers
No one else spoke at two or more of the same events.
Speakers with the same name are merged into one entry, so this page may combine more than one person. Affiliations are shown as each conference listed them.