Skip to content
Data Engineering Podcast cover art

All Episodes

Data Engineering Podcast — 518 episodes · page 1 of 6

#
Title
1

Reducing Data Debt with Agile Ledger Architecture

2

What Context Really Means in Data Engineering and AI

3

Specialized AI for Data Engineers: Inside Astronomer’s Otto

4

Why Multi-Agent Systems Need Shared State, Graph Semantics, and Governance

5

Building the Context Flywheel for AI Data Agents

6

Holding Kafka Right: Product-Friendly Streaming with TypeStream

7

Text to Data Products: Kaarvi’s End-to-End AI for Ingestion, Quality, and Dashboards

8

Scaling Graph Analytics Without ETL: Inside PuppyGraph’s Architecture

9

Maximizing GPU Utilization: Heterogeneous Pipelines with Ray and Kubernetes

10

The AI-First Data Engineer: 10–50x Productivity and What Changes Next

11

Treat Metering Like Finance: Building Data Platforms for Consumption Economics

12

Beyond the PDF: Rowan Cockett on Reproducible, Composable Science

13

Beyond Prompts: Practical Paths to Self‑Improving AI

14

Orion at Gravity: Trustworthy AI Analysts for the Enterprise

15

From Models to Momentum: Uniting Architects and Engineers with ER/Studio

16

From Data Models to Mind Models: Designing AI Memory at Scale

17

Prompt Management, Tracing, and Evals: The New Table Stakes for GenAI Ops

18

From Legacy to AI-Ready: How MongoDB AMP Accelerates Modernization

19

Branches, Diffs, and SQL: How Dolt Powers Agentic Workflows

20

Logical First, Physical Second: A Pragmatic Path to Trusted Data

21

Your Data, Your Lake: How Observe Uses Iceberg and Streaming ETL for Observability

22

Semantic Operators Meet Dataframes: Building Context for Agents with FENIC

23

Beyond Dashboards: How Data Teams Earn a Seat at the Table

24

Unfreezing The Data Lake: The Future-Proof File Format

25

From Context to Semantics: How Metadata Powers Agentic AI

26

From Data Engineering to AI Engineering: Where the Lines Blur

27

Malloy: Hierarchical Data, Semantic Models, and the Future of Analytics

28

Blurring Lines: Data, AI, and the New Playbook for Team Velocity

29

State, Scale, and Signals: Rethinking Orchestration with Durable Execution

30

The AI Data Paradox: High Trust in Models, Low Trust in Data

31

Bridging the AI–Data Gap: Collect, Curate, Serve

32

Beyond the Perimeter: Practical Patterns for Fine‑Grained Data Access

33

The True Costs of Legacy Systems: Technical Debt, Risk, and Exit Strategies

34

Context Engineering as a Discipline: Building Governed AI Analytics

35

The Data Model That Captures Your Business: Metric Trees Explained

36

From GPUs-as-a-Service to Workloads-as-a-Service: Flex AI’s Path to High-Utilization AI Infra

37

From RAG to Relational: How Agentic Patterns Are Reshaping Data Architecture

38

Duck Lake: Simplifying the Lakehouse Ecosystem

39

Aligning Business and Data: The Essential Role of Data Modeling

40

From Academia to Industry: Bridging Data Engineering Challenges

41

High Performance And Low Overhead Graphs With KuzuDB

42

Bridging Data and Decision-Making: AI's Role in Modern Analytics

43

From Bits to Tables: The Evolution of S3 Storage

44

Revolutionizing Python Notebooks with Marimo

45

Warehouse Native Incremental Data Processing With Dynamic Tables And Delayed View Semantics

46

Streamlining Data Pipelines with MCP Servers and Vector Engines

47

Foundational Data Engineering At Two Sigma

48

Enabling Agents In The Enterprise With A Platform Approach

49

Dagster's New Era: Modularizing Data Transformation in the Age of AI

50

AI and the Lakehouse: How Starburst is Pioneering New Workflows

51

Amazon S3: The Backbone of Modern Data Systems

52

Scaling Data Operations With Platform Engineering

53

From Data Discovery to AI: The Evolution of Semantic Layers

54

Balancing Off-the-Shelf and Custom Solutions in Data Engineering

55

StarRocks: Bridging Lakehouse and OLAP for High-Performance Analytics

56

Exploring NATS: A Multi-Paradigm Connectivity Layer for Distributed Applications

57

Advanced Lakehouse Management With The LakeKeeper Iceberg REST Catalog

58

Simplifying Data Pipelines with Durable Execution

59

Overcoming Redis Limitations: The Dragonfly DB Approach

60

Bringing AI Into The Inner Loop of Data Engineering With Ascend

61

Astronomer's Role in the Airflow Ecosystem: A Deep Dive with Pete DeJoy

62

Accelerated Computing in Modern Data Centers With Datapelago

63

The Future of Data Engineering: AI, LLMs, and Automation

64

Evolving Responsibilities in AI Data Management

65

CSVs Will Never Die And OneSchema Is Counting On It

66

Breaking Down Data Silos: AI and ML in Master Data Management

67

Building a Data Vision Board: A Guide to Strategic Planning

68

How Orchestration Impacts Data Platform Architecture

69

An Exploration Of The Impediments To Reusable Data Pipelines

70

The Art of Database Selection and Evolution

71

Bridging Code and UI in Data Orchestration with Kestra

72

Streaming Data Into The Lakehouse With Iceberg And Trino At Going

73

An Opinionated Look At End-to-end Code Only Analytical Workflows With Bruin

74

Feldera: Bridging Batch and Streaming with Incremental Computation

75

Accelerate Migration Of Your Data Warehouse with Datafold's AI Powered Migration Agent

76

Bring Vector Search And Storage To The Data Lake With Lance

77

The Role of Python in Shaping the Future of Data Platforms with DLT

78

Build Your Data Transformations Faster And Safer With SDF

79

Scaling Airbyte: Challenges and Milestones on the Road to 1.0

80

Enhancing Data Accessibility and Governance with Gravitino

81

The Evolution of DataOps: Insights from DataKitchen's CEO

82

Achieving Data Reliability: The Role of Data Contracts in Modern Data Management

83

How Generative AI Is Impacting Data Engineering Teams

84

The Role of Product Managers in Data-Centric Organizations

85

Neon: A Serverless And Developer Friendly Postgres

86

Improve Data Quality Through Engineering Rigor And Business Engagement With Synq

87

Stitching Together Enterprise Analytics With Microsoft Fabric

88

Being Data Driven At Stripe With Trino And Iceberg

89

X-Ray Vision For Your Flink Stream Processing With Datorios

90

Practical First Steps In Data Governance For Long Term Success

91

Data Migration Strategies For Large Scale Systems

92

Zenlytic Is Building You A Better Coworker With AI Agents

93

Release Management For Data Platform Services And Logic

94

Barking Up The Wrong GPTree: Building Better AI With A Cognitive Approach

95

Build Your Second Brain One Piece At A Time

96

Making Email Better With AI At Shortwave

97

Designing A Non-Relational Database Engine

98

Establish A Single Source Of Truth For Your Data Consumers With A Semantic Layer

99

Adding Anomaly Detection And Observability To Your dbt Projects Is Elementary

100

Ship Smarter Not Harder With Declarative And Collaborative Data Orchestration On Dagster+