11 posts about schema evolution by 6 contributors.
Know schema evolution? Share what you know with developers who are learning it.
Learn how to add columns to Delta Lake tables with schema evolution, use mergeSchema in PySpark, and safely manage compatibility with streaming jobs.
Learn how Amazon S3 Tables supports Apache Iceberg V3, including nanosecond timestamps, variant data, schema evolution, and implications for data lake design.
Build a LangGraph multi-agent RAG pipeline that supports legacy and modern schemas during enterprise knowledge-base migrations using unified models, hybrid retrieval, and persistent state.
In this article, you'll learn how Databricks Auto Loader actually works under the hood - not just the five-line tutorial version. It covers file discovery (directory listing vs. event-based), the five schema evolution modes and when to use each, throughput controls like maxFilesPerTrigger and maxBytesPerTrigger, file metadata and lineage, the built-in cloud_files_state() audit function, trigger strategy, and what Auto Loader's exactly-once guarantee actually promises (and doesn't
Learn how to stream SharePoint data to Databricks using Declarative Automation Bundles, Unity Catalog, schema evolution, and scalable Azure Databricks pipelines.
Learn how PostgreSQL 19 partition merge and split capabilities can simplify online schema changes while reducing migration risk, downtime, and operational complexity.
Learn how Data Contracts prevent breaking changes in data pipelines through schema validation, governance, ownership, and automated compatibility checks.
Learn Apache Iceberg architecture, ACID transactions, schema evolution, time travel, and query optimization for building scalable modern data lakes.
Apache Iceberg: The open table format revolutionizing data lakehouses with ACID transactions, schema evolution, and time travel for massive analytics.
Apache Iceberg: Revolutionize your data lake with ACID, schema evolution, time travel, and enhanced performance for massive analytics workloads.
Apache Iceberg revolutionizes data lakes with database-like features for developers. Manage large datasets reliably with ACID, schema evolution, and time travel.
DevSocialUpcoming · 3rd editionAI Agents ConferenceNov 23–27, 2026Live onlineMembers only17days leftRegisterPublish an article in this category and earn +1,000 SHARP when it is approved.
Write an article