Jerry Zhang

Beyond One-Size-Fits-All: Building Domain-Specific Language Models With PyTorch - Mayank Kumar, DeepTempo Double LLM RAG Accuracy by Adding GNNs - Serge Panev, NVIDIA Serving Transformers at Scale: KV-Cache-Aware Routing for PyTorch Inference - Maroon Ayoub, IBM & Tyler Michael Smith, Red Hat...

Accelerating Normalization Under Torch.Compile with Tl.Reduce - Peter Bell, Quansight This poster will showcase my recent (and ongoing) work allowing TorchInductor to calculate the variance in a single pass over the input; which results in large speedups for torch.compile'd normalization layers....