Discover · feedburner.com

SE Radio 741: Sahil Walia on Schema Changes and Data Migrations

JUST™ Creative feedburner.com

Sahil Walia, a senior technical architect at Snowflake, joins host Robert Blumen for a conversation about schema migration and data migration. Together, they discuss the basics of schema: do all data sets have schema?; what drives schema change?; are data migration and schema migration the same thing? Must they happen at the same time? They then talk about the challenges and failure modes of schema migration, including challenges at scale, migrating without downtime, the concept of "safety" in data migrations, and safety patterns for data migration - double writes, read repair, replication, ending on the Apache Iceberg case study.

Length
47:02
More ways to use this
Open on another device
Scan this QR code to open the same public page

Scan to open this page. Your saved notes and account access are not included.

Download QR code

Open the page link

Keep going

Each of these is read from what this estate already kept: the feed a piece came through, the publisher behind it, the credits and topics the publisher printed. None of it is a recommendation, an identity or a record kept anywhere else.

Also from JUST™ Creative

  1. SE Radio 746: Marian Kamenistak on Product Management for Software EngineersSE Radio feedburner.com
  2. SE Radio 745: Andrew Tridgell on Flight Control SoftwareSE Radio feedburner.com
  3. SE Radio 744: Danilo Krummrich on Rust in the Linux KernelSE Radio feedburner.com
  4. SE Radio 743: Sowjanya Pandruju on Managing Agent StateSE Radio feedburner.com
  5. SE Radio 742: Tim Varelmann on Mathematical Optimization for Software EngineersSE Radio feedburner.com
  6. SE Radio 740: Raju Dandigam on Building Production AI AgentsSE Radio feedburner.com