1.5 PB to 400 GB: Redshift to Snowflake + Apache Iceberg

1.5 PB to 400 GB: Redshift to Snowflake + Apache Iceberg How we migrated 1.5 PB of data — including a 169 TB table — from Amazon Redshift to Snowflake and Apache Iceberg in 90 days, reducing storage by 73%. When a client came to us running 1.5 petabytes of data on Amazon Redshift, the […]

Central Data Team Often Becomes Blockers

Central Data Team Often Becomes Blockers Why centralized data teams slow down analytics and how Data Mesh helps modernize data architecture. I have been working as a Data Engineer for many years and have helped migrate, transform, and modernize data teams for many companies. But at the end of the day, the data team often […]