PODCAST · technology
This Week in Open Lakehouse
by Lisa Cao and Scott Haines
This Week in Open Lakehouse is a weekly data engineering podcast discussing the latest in open source news, including query engines, data catalogs, open table formats, orchestrators, and streaming technologies. Produced by the Databricks DevRel team. https://openlakehouse.io/
Episodes
-
Unity Catalog 0.7, Paimon 2.1, Hudi 1.1.2, Arrow 26.0, and new ASF top-level projects
Scott Haines and Lisa Cao are back after a flu-delayed skip, just in time for Week 42 — which, yes, is our favorite week - "Hitchhiker’s Guide" week. We tear through a stacked open lakehouse release week, led by Unity Catalog 0.7.0, shipping native Iceberg REST catalog support, with Paimon, Hudi,...
-
DataFusion Ballista 55.0, Unity Catalog Native Iceberg Support, Parquet VECTOR type, and MLflow 3.17
In this episode, Lisa and Scott cover a dense week of open-source data infrastructure updates from Community Over Code and Data and AI Weekend. They explore new release activity across the lakehouse stack, the growing role of AI agents and policy enforcement, and the emerging standards that will...
-
Iceberg 1.12, OIDC Credentials, Spark Connect Gateway, Arrow JSON Schemas, and Release Management
In this episode, Lisa and Scott explore the latest developments across the open data ecosystem, including Delta Rust, Apache Iceberg, Apache Spark, Rust-native infrastructure, and the challenges of keeping rapidly evolving technologies interoperable. They discuss release velocity, governance,...
-
XML Functions, Polars 2.0, delta-rs, and Agent Thrashing Policies
In this episode, Lisa and Scott explore recent updates in ecosystem technologies including Apache Iceberg, Apache Flink, Polars, delta-rs, highlighting their frustrations in agent workflows and a potential oversight on the importance of XML. Iceberg 1.12: REST catalogs, C++ support, equality...
-
FileTypes, Language-Agnostic UDFs, Parquet Versioning, and Iceberg Updates
In this episode, Lisa and Scott explore recent updates in data ecosystem technologies including Apache Iceberg, Apache DataFusion, Apache Parquet, and the Lakekeeper Iceberg Rest Catalog, highlighting their implications for data management and interoperability. Iceberg Data Fusion integration...
-
Nanosecond Timestamp Precision, Iceberg-Datafusion,Spark Connect Rust Client, and Parquet Types
The biggest throughline this week is format-layer consolidation. Apache Parquet 2.14.0 shipped as a final release, carrying chronological ordering for INT96 timestamps and Variant documentation fixes, while a parallel dev-list debate over versioning semantics and reader behavior for unsupported...
We're indexing this podcast's transcripts for the first time — this can take a minute or two. We'll show results as soon as they're ready.
No matches for "" in this podcast's transcripts.
No topics indexed yet for this podcast.
Loading reviews...
ABOUT THIS SHOW
This Week in Open Lakehouse is a weekly data engineering podcast discussing the latest in open source news, including query engines, data catalogs, open table formats, orchestrators, and streaming technologies. Produced by the Databricks DevRel team. https://openlakehouse.io/
HOSTED BY
Lisa Cao and Scott Haines
CATEGORIES
Loading similar podcasts...