Skip to content
EP 17 : Designing Data-Intensive Applications: Building Reliable, Scalable, and Maintainable Systems episode artwork

Jan 5, 2026 8 min

EP 17 : Designing Data-Intensive Applications: Building Reliable, Scalable, and Maintainable Systems

from SD Podcast Hosted by Ian Villanueva

In this episode, we dive into the fundamental principles for building software systems that are reliable, scalable, and maintainable. We move past industry buzzwords to gain a technically precise understanding of the various technologies and trade-offs involved in modern data processing.We explore the transition from compute-intensive to data-intensive applications, where the primary challenges are the quantity, complexity, and speed of change of data. The discussion covers the evolution of data models, comparing the traditional relational model with the more recent document and graph models, and how these choices affect the way we think about the problems we solve.Listeners will gain insights into the internals of storage engines, including the differences between log-structured merge-trees (LSM-trees) and B-trees, as well as the distinction between transactional (OLTP) and analytic (OLAP) workloads. We also address the intricate challenges of distributed data, such as the trade-offs in synchronous versus asynchronous replication, the necessity of partitioning (sharding) for scalability, and the foundational role of consensus in achieving fault tolerance.Finally, we examine how to integrate these systems using batch and stream processing to create derived data, such as search indexes and caches, ensuring your application architecture remains robust as it grows. Understanding these complex systems is like building with a garden hose: while you can screw different segments together to massage data in new ways, you must ensure the underlying plumbing is strong enough to handle the pressure without springing a leak.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

EP 17 : Designing Data-Intensive Applications: Building Reliable, Scalable, and Maintainable Systems

0:00 8:13

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of SD Podcast?

This episode is 8 minutes long.

When was this SD Podcast episode published?

This episode was published on January 5, 2026.

Can I download this SD Podcast episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.