John Gray

SAP operations teams spend hours sifting through thousands of log lines to diagnose outages, often only after business impact has occurred. In this workshop, learn how to implement AI-powered operations for SAP workloads on AWS, whether customer-managed or RISE with SAP.

Dive deep into AWS Trainium's Neuron Kernel Interface (NKI) and unlock its potential for high-performance machine learning (ML). This session explores hardware foundations, kernel basics, and advanced techniques for optimizing ML workloads.

In this builder's session, dive into the practical implementation of model distillation techniques using AWS Trainium instances and the Neuron SDK. Learn how to compress large language models into smaller, efficient versions while maintaining performance and accuracy.

Large language models (LLMs) demonstrate exceptional performance across many general-purpose applications due to their extensive pretraining on a wide variety of datasets.

As deep learning models have grown in size and complexity, there is a need for specialized ML accelerators to address the increasing training and inference demands of these models, while also delivering high performance, scalability, and cost-effectiveness.