Richard Zou

Automatic Comm-Compute Overlap and Bucketing in torch.compile - Elias Ellison & Ivan Kobzarev, Meta Flexible Custom Operators: custom ops with arbitrary inputs and outputs  - Angela Yi & Richard Zou, Meta How Your Code Becomes a Kernel - Harshita Varma, Juspay; Nikita Verma, Individual TorchCodec:...

This talk dives into Generative AI (GenAI) inference, highlighting key features of torch.compile that make it well suited for this rapidly evolving field. We’ll explore how torch.compile enables efficient and scalable inference for large language models with features like precompilation, multigraph...

These sessions give participants an opportunity to meet some of the developers leading PyTorch to foster collaboration, gather feedback, and inspire contributions and collaboration. PyTorch Compiler: In 2022, we brought compiler technologies to PyTorch with TorchDynamo providing sound graph capture...

In this talk, we'll go over the new recommended APIs to extend PyTorch with custom Python/C++/CUDA operators. Users have been able to extend PyTorch with custom operators for years but we have updated our guidance for creating custom operators that compose with torch.compile, autograd, and other...