Fundamentals of Apache Spark | Think Tech #14

Episode 48 of the Think Tech podcast, hosted by Shivam Mohan, titled "Fundamentals of Apache Spark | Think Tech #14" was published on July 24, 2023 and runs 21 minutes.

July 24, 2023 ·21m · Think Tech

0:00 / 0:00

Summary

Join me in this engaging and comprehensive episode of Think Tech that explores the powerful distributed computing system, Apache Spark, designed for big data processing. The episode covers the core concepts and inner workings of Spark, emphasizing its memory-centric architecture that enables lightning-fast processing and real-time or near-real-time capabilities. Listeners gain insights into Spark's fault-tolerant master/worker model, the significance of partitions for parallel processing, and the three essential data abstractions - RDD, Dataframe, and Dataset. The podcast also delves into Actions and Transformations, explaining their roles in optimizing data processing workflows. Additionally, the Spark Session as the entry point and the execution modes (Client, Cluster, and Local) for different scenarios are highlighted. Overall, the episode serves as an essential guide for understanding Apache Spark and its groundbreaking contributions to the world of big data processing.

Episode Description

Join me in this engaging and comprehensive episode of Think Tech that explores the powerful distributed computing system, Apache Spark, designed for big data processing. The episode covers the core concepts and inner workings of Spark, emphasizing its memory-centric architecture that enables lightning-fast processing and real-time or near-real-time capabilities. Listeners gain insights into Spark's fault-tolerant master/worker model, the significance of partitions for parallel processing, and the three essential data abstractions - RDD, Dataframe, and Dataset. The podcast also delves into Actions and Transformations, explaining their roles in optimizing data processing workflows. Additionally, the Spark Session as the entry point and the execution modes (Client, Cluster, and Local) for different scenarios are highlighted. Overall, the episode serves as an essential guide for understanding Apache Spark and its groundbreaking contributions to the world of big data processing.

Share this episode

Similar Episodes

#5 ALZHEIMER'S FYI – Sleep Tracking as a Tool For Caregivers (Guest: Philippe Kahn)

Jun 7, 2025 ·45m

Careless People by Sarah Wynn Williams

May 14, 2025 ·40m

Mood Machine by Liz Pelly

Mar 12, 2025 ·37m

Cyberboss by Craig Gent

Feb 26, 2025 ·40m

#4 ALZHEIMER'S FYI - Food, Water & Sleep Tracking (Guest Mom)

Jan 2, 2025 ·13m

#3 ALZHEIMER'S FYI - Trends, Digital Tips & Tricks for Caregivers (Guest Mom)

Nov 9, 2024 ·18m

Similar Podcasts

Think Freely Jordan Russell Gray Exploring humans, systems and emerging technologies. Your philosophy matters. Think Like a Man by Afrivazi Valerie Nyamwaya Men, Afrivazi crew, Sound, Real men, Real conversations on relationships(family and friends), money, tech, sports, women and everything important to men Think It•Grow It•Get It Audio Experience w/ Kingsley Cartwright K.C. Milian In this Think It-Grow It-Get It Audio Experience w/ Kingsley Cartwright, I want to discuss tips, tricks, and techniques to help you align your being with the natural laws of attraction. Success often comes as a result of consciously or unconsciously following the laws of attraction. So I have to ask the question, what do we truly want to achieve in life and why not make our actions deliberate to succeed?So, listen in, as you may become inspired to evolve into the best version of yourself. I Think I Know Basketball Marquis Neal, Khari Thompson Do you think you know basketball? Khari and Marquis do, and they want all the smoke!Marquis Neal is a Broadcast Radio Technician at WBUR in Boston. Khari Thompson is a sports writer for Boston.com/Boston Globe.

URL copied to clipboard!