Prashant Gupta

When your data consumers shift from 10,000 humans to 100,000 high-speed agents, “governance” can no longer mean a wiki page or a PDF policy document. Agents don’t read wikis; they need semantic, machine-readable guardrails. In this talk, the Data Platform team discusses our pivot to “agent-ready governance.” We are moving beyond simple access control lists (ACLs) to a model where Unity Catalog provides deep semantic context, usage constraints and “rules of the road” that our 100,000 agents can natively understand. Join us to see how we ensure that our digital workforce operates safely, preventing the chaos of 100,000 bots making bad decisions at machine speed.

Ingesting data from SaaS systems sounds straightforward—until you hit API limits, miss SLAs, or accidentally ingest PII. Sound familiar? In this talk, we’ll share how Databricks evolved from scrappy ingestion scripts to a unified, secure, and scalable ingestion platform. Along the way, we’ll highlight the hard lessons, the surprising pitfalls, and the tools that helped us level up. Whether you’re just starting to wrangle third-party data or looking to scale while handling governance and compliance, this session will help you think beyond pipelines and toward platform thinking.