juliano.fonseca juliano.fonseca

At Nubank, we successfully migrated to Unity Catalog, addressing the needs of our large-scale data environment with 3k active users, over 4k notebooks and jobs and 1.1 million tables, including sensitive PII data. Our primary objectives were to enhance data governance, security and user experience.Key points: - Comprehensive data access monitoring and control implementation - Enhanced security measures for handling PII and sensitive data - Efficient migration of 4,000+ notebooks and jobs to the new system - Improved cataloging and governance for 1.1 million tables - Implementation of robust access controls and permissions model - Optimized user experience and productivity through centralized data management This migration significantly improved our data governance capabilities, enhanced security measures and provided a more user-friendly experience for our large user base, ultimately leading to better control and utilization of our vast data resources.