#38: How Apache Sedona Solved Big Data’s Hardest Problem ...

What this episode covers

Large Language Models can write poetry and debug code, but they still don't understand the fundamental physics of the real world. Ask an AI to find the "nearest restaurant" to a specific coordinate, and it struggles because it lacks Spatial Intelligence.In this episode, we sit down with Jia Yu, the co-creator of Apache Sedona and co-founder of Wherobots, to discuss why geospatial data breaks standard big data engines and how he built the solution that now powers over 2 million downloads a month.We trace the 10-year journey from a PhD research paper to a top-level Apache project, diving into the deep technical challenges of distributed computing. Jia explains why spatial data requires a completely different architecture than standard text or numbers and how the industry is finally moving toward a "Spatial Lakehouse" to break down data silos.In this episode, we explore:- The "Multimodality" Trap: Why mixing vector, raster, and LiDAR data crashes traditional systems.- How SedonaDB is bringing massive scale to single-node machines (so you don't always need a cluster).- The hardest problem in distributed computing - How to split a map across 1,000 servers without breaking the data.- The multi-year fight to get native geometry support into Apache Iceberg.- Why the next generation of models must evolve from text-based to spatially intelligent.✅ Sign Up for Wherobots: https://wherobots.com/✅ Learn more about Apache Sedona: https://wherobots.com/apache-sedona/✅ What is Apache Sedona: https://wherobots.com/blog/what-is-apache-sedona/✅ Test out SedonaDB: https://sedona.apache.org/sedonadb/latest/✅ Connect with Jia on LinkedIn: https://www.linkedin.com/in/dr-jia-yu/ 00:00:00 - Intro & Welcome 00:00:51 - The Origin Story: From GeoSpark to Apache Sedona 00:06:03 - Why Geospatial Data is "Special" (The Multimodality Problem) 00:09:47 - When to Move to Distributed Computing? 00:13:21 - The Secret to Maintaining a Vibrant Open Source Community00:18:11 - The Features That Drove Adoption: Spatial SQL & Python 00:22:35 - Deep Dive: How Spatial Partitioning Works 00:28:57 - Why Build a Cloud-Native Platform? 00:33:05 - The Rise of the Spatial Lakehouse & Apache Iceberg 00:40:17 - Introducing SedonaDB: A Single-Node Engine 00:45:10 - The Future: Why AI Needs Spatial Intelligence 00:48:44 - Advice for Getting Started with Spatial Engineering📰 Daily modern GIS insights: https://forrest.nycCONNECT WITH ME📸 Instagram: https://www.instagram.com/matt_forrest/💼 LinkedIn: https://www.linkedin.com/in/mbforr/📧 Newsletter: https://forrest.nyc🌐 Website: https://forrest.nyc

PodParley-generated summary based on available episode metadata and transcript content.

Share this episode

Similar Episodes

I'm ok

Mar 26, 2026 ·1m

REMIX: Why we over-shop and compulsively acquire, and how to stop, with Dr Jan Eppingstall

Jan 9, 2026 ·61m

REMIX: OCD and hoarding disorder with Jenna Overbaugh

Jan 2, 2026 ·47m

REMIX: Therapy and hoarding disorder - what are the options? With Dr Jan Eppingstall

Dec 26, 2025 ·78m

REMIX: ADHD and hoarding disorder with Professor Sharon Morein

Dec 21, 2025 ·46m

#207 13 actionable pieces of mental health advice from six former podcast guests

Dec 12, 2025 ·53m

Similar Podcasts

MG Show MG Show The MG Show, hosted by Jeffrey Pedersen and Shannon Townsend, is a leading alternative media platform dedicated to uncovering the truth behind today’s most pressing political issues. Launched in 2019, the show has grown exponentially, offering unfiltered insights, comprehensive research, and real-time analysis. With a commitment to independent journalism and factual integrity, the MG Show empowers its audience with knowledge and encourages active participation in the political discourse. French Your Way Jessica: Native French teacher founder of French Your Way Boost your French listening skills and test your comprehension with this one of a kind series of podcasts. Get the chance to listen to a real conversation between native speakers talking at normal speed AND customise your learning experience through carefully designed sets of questions (2 levels of difficulty) available for download at www.frenchvoicespodcast.com. All interviews also come with the transcript. French teacher Jessica interviews native speakers of French from around the world who share a bit of their life and passion. Where else would you meet in one same place a French yoga teacher based in Melbourne, a soap manufacturer from Provence, or a couple cycling around the world? That Hoarder: Overcome Compulsive Hoarding That Hoarder Hoarding disorder is stigmatised and people who hoard feel vast amounts of shame. This podcast began life as an audio diary, an anonymous outlet for somebody with this weird condition. That Hoarder speaks about her experiences living with compulsive hoarding, she interviews therapists, academics, researchers, children of hoarders, professional organisers and influencers, and she shares insight and tips for others with the problem. Listened to by people who hoard as well as those who love them and those who work with them, Overcome Compulsive Hoarding with That Hoarder aims to shatter the stigma, share the truth and speak openly and honestly to improve lives. The Small Business Startup School – Business Notes | Financial Literacy | Retail Psychology – For Professionals & Entrepreneurs The Small Business Startup School Inc. Starting or buying a small business? While personal circumstances may vary, business patterns remain timeless. On The Small Business Startup School, we explore strategies, insights, and practical solutions to help entrepreneurs confidently navigate their journey.Hosted by Ola Williams—a retail entrepreneur, fintech founder, and financial coach with over two decades of experience—this podcast marries financial awareness and retail psychology with optimism to deliver actionable takeaways.Join us to learn, grow, and connect as we uncover the keys to business success.Let’s continue to learn together and be encouraged to keep on connecting!

Frequently Asked Questions

How long is this episode of Spatial Stack with Matt Forrest?

This episode is 54 minutes long.

When was this Spatial Stack with Matt Forrest episode published?

This episode was published on January 29, 2026.

What is this episode about?

Large Language Models can write poetry and debug code, but they still don't understand the fundamental physics of the real world. Ask an AI to find the "nearest restaurant" to a specific coordinate, and it struggles because it lacks Spatial...

Can I download this Spatial Stack with Matt Forrest episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.