Angela Yi

Automatic Comm-Compute Overlap and Bucketing in torch.compile - Elias Ellison & Ivan Kobzarev, Meta Flexible Custom Operators: custom ops with arbitrary inputs and outputs  - Angela Yi & Richard Zou, Meta How Your Code Becomes a Kernel - Harshita Varma, Juspay; Nikita Verma, Individual TorchCodec:...

Accelerator and Quantization Support on ExecuTorch - Chen Lai, Meta Agents in Space - George Williams, Armijo Innovations Enabling End-to-end Embedded ML Applications With ExecuTorch for the Arm Ethos-U NPU - George Gekov, Arm ExecuTorch for ML Inference on Edge Devices Running Zephyr RTOS - Bujji...

Beyond One-Size-Fits-All: Building Domain-Specific Language Models With PyTorch - Mayank Kumar, DeepTempo Double LLM RAG Accuracy by Adding GNNs - Serge Panev, NVIDIA Serving Transformers at Scale: KV-Cache-Aware Routing for PyTorch Inference - Maroon Ayoub, IBM & Tyler Michael Smith, Red Hat...

A Case Study of Torch.compile-induced Timeouts in Distributed - Simon Fan & Brian Hirsh, Meta Activation Checkpoint 2: A New Graph-capture-based Activation Checkpoint - Jeffrey Wan, Meta Automatic Parallelism in PyTorch - Will Constable & Francisco Massa, Meta Breaking Less: Tackling Graph Breaks...

This talk discusses updates we've made to torch.export this past year: (a) Non-strict mode, an alternative tracing mode which in practice covers more programs than TorchDynamo without compromising important soundness guarantees (b) Better dynamic shapes specifications through generating suggested...

Purge the GIL: Improved Torch.DataLoader - Michal Szolucha & Rostan Tabet, NVIDIA XFormers - Daniel Haziza, Meta AI  TritonCC: AOT Triton Workflow for TorchScript C++ Runtime - Sijia Chen & Huamin Li, Meta The PyTorch 2.0 Inference Story - Angela Yi, Bin Bao, Sheng Qin & Sherlock Huang, Meta Tensor...

This technical session caters to on-device AI engineers, providing insights into developer flows with PyTorch Edge. Through our semi-live demos and code showcases, attendees will embark on a journey to understand the research-to-production workflow using PyTorch Edge. Discover how our APIs and...