Associate Consultant, Lead Data Engineer, Tata Consultancy Services, Austin – TX
Title of the Talk :
Large-Scale Migration Effort within a Global Enterprise
Abstract of Talk:
As organizations modernize their data ecosystems, migrating from legacy on-premise platforms like Teradata to cloud-native solutions such as Snowflake presents both strategic opportunities and technical challenges. In this session, I will walk through real-world lessons learned during a large-scale migration effort within a global enterprise. The focus will be on designing resilient data integration pipelines that ensure data consistency, minimal downtime, and scalable performance.Attendees will gain insights into how internal job frameworks were leveraged to automate ETL/ELT workloads and streamline schema translation. I will share strategies for building validation checkpoints, managing parallel loads, and maintaining lineage visibility across the old and new platforms during cutover. Emphasis will also be placed on metadata-driven pipeline design and internal observability tooling to support auditability and compliance throughout the migration.This talk is ideal for engineers, architects, and program leads looking to understand practical patterns and pitfalls in transforming traditional data warehouses into high-performance, cloud-native data environments.
