Alex Warnecke

The pace of AI development has reset what security teams need to deliver. At Databricks, we've built an AI Security team that operates at the frontier of the technology it defends. This session is an inside look at how. We'll share the human-in-the-loop agents we built to assess security issues across our AI products and services, and why an early, disciplined bet on agent benchmarking got us to 95.8% accuracy on agent-generated findings, and how we use expert reviewers validating every result so nothing slips through. Then we'll open the hood on how we secure the coding agents our own engineers use every day: managed client-side settings, agent sandboxes, an AI Gateway and MCP Gateway enforcing policy server-side where admin access can't reach, and continuous scanning of every Databricks App, plugin, and skill.Real architecture. Real numbers. Real failure modes. A practical look at what a modern AI security function looks like in production.