*DataPoint* Accelerating AI with Python-native Ray and the Importance of Open Source in AI episode artwork

EPISODE · Jun 16, 2023 · 16 MIN

*DataPoint* Accelerating AI with Python-native Ray and the Importance of Open Source in AI

from Data Driven

On this episode of Data Driven, we explore the topic of distributed computing frameworks for AI and ML workloads. Frank discusses the advancements of Ray, a new technology based on Python language, with performance enhancements that could range from 10-12 times faster to thousands of times faster in extreme cases. We delve into the power of open source artificial intelligence and how it can aid data endeavors to accelerate these efforts. Along the way, we touch upon IBM and Red Hat's partnership, the evolution of technology, the importance of problem-specific solutions, and more. Stay tuned for a new episode of "Data Driven" and a special segment from our speaker on the potential AI holds for our future.[00:01:50] Ray is a new computing framework for AI/ML, may replace Spark, based on Python, can free people from PySpark.[00:03:49] Speaker has a MacBook M2 and prefers it over Windows. They enjoy stream-side streaming and wrote an article prompted by a question at work about a new technology claiming to be the next big data processing framework. They believe Ray still has an advantage.[00:06:51] Webinar about power of IBM-Red Hat partnership in AI. Speaker mentions travel with family and introduces production assistant.[00:11:34] Tech anticipated, surprised by speed of Chat GPT. Some dismiss as a fad, but it's different from predictive text like comparing paper airplane to an Airbus A 380, based on same principles but very different in implementation and technology.[00:13:30] Encourage attendance at AI webinar showcasing ethical concerns. Open source needed for transparency and risk-sharing. AI impact on all, even entry-level jobs and economy.

Podcast Topics Summarized: 1. Ray - a new distributed computing framework for AI and ML workloads - Ray's potential to replace Spark and its Python-based architecture - Latest performance enhancements and potential benefits for big data processing - Speaker's off-topic mention of their need for a haircut and upcoming AI webinar 2. Open Source Technology - importance, transparency, innovation sharing, and societal risks - AI's impact on job economy and upcoming AI-focused webinars - Partnership between IBM and Red Hat to aid AI and data endeavors - Chat GPT and its technological advancements and differences from predictive text - Speaker's request for advice on platform usage and backlog of "Data Driven" shows 3. Speaker Excerpts - Importance of maturity, need for coffee, and discussions of coffee-preparation techniques - Reflection on the evolution of technology and human psychology of expectations - Comparison of Spark and Hadoop and the need for open-source projects to solve specific problems - Speaker's personal experience with MacBook M2, "stream side streaming," and article on new data-processing framework Key Takeaways: - Ray, an AI/ML distributed computing framework, and its potential improvements over Spark and potential for big data processing - Importance of open source mentality for innovation, transparency, and societal risks with AI - Technological advancements with Chat GPT and seeking suggestions on a platform for usage - Speaker's personal experiences and upcoming webinars and shows

NOW PLAYING

*DataPoint* Accelerating AI with Python-native Ray and the Importance of Open Source in AI

0:00 16:13

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

NEWMORROW SESSIONS - A PodCast Series on the Future of Hospitality Mario C. Bauer, Florian Schneider, Axel Weber & Dr. Tillman Bardt The Newmorrow PodCast is more than a podcast — it's a platform for open dialog on the future of our business, a platform for those building what doesn’t exist yet. Here, we share and embrace our passion for the hospitality industry, but we won’t romanticize the journey. We ask the tough questions, confront uncomfortable truths, and prepare for a future that resists easy answers. We believe that the tougher and wilder times become, the more openly, honestly and humanely people need to talk to each other and act together. We believe, openness, togetherness, and truthfulness should also be cornerstones of a professional community to develop our utopian idea of „open source“. This is a space where visionaries don’t just imagine the future — they wrestle with the paradoxes that shape it: success vs. happiness, data vs. instinct, stability vs. reinvention. Join leaders, entrepreneurs, and thinkers as they share not what made them — but what’s actively shaping them, now and next. So tune in The Health Odyssey: Navigating Tomorrow's Medicine Podcast Welcome to 'The Health Odyssey: Navigating Tomorrow's Medicine,' where we embark on an adventurous journey through the ever-evolving world of healthcare. Each episode is like a treasure map, guiding you through the rich tapestry of ancient healing arts mixed with futuristic tech wizardry. We’ll chat about the wild west of health data privacy, the corporate giants reshaping our care, and the mind-bending potential of psychedelics for mental wellness. Think of us as your trusty sidekicks, unraveling the mysteries of modern medicine while keeping it real and relatable. Let’s dive into the stories, the science, and the soul of healthcare, paving the way for a healthier tomorrow. Talent Stacker Jonathan Mendonsa Data suggests that the average cost of college in 2019 was $122,000 while the entry-level salary for a college graduate at the same time period was 50,000. ROI is a distant memory.hopefully for that that $122,000 the student graduates with a degree and possibly some skills. The reality is, as most individuals approach graduation, they realize that ultimately what they have to prove to their employers that they actually have the skills and since you don't need a degree or permission to start building skills, let’s document the stories and best practices of individuals that crushed the game by focusing on building their skills and their talent stack. Maybe you feel like you don’t have a talent stack. What are the skills you need to be able to generate an above-median income and when paired with interest-led learning this talent stack will allow you to work towards financial independence and design your future?If you're up for this challenge to go from no Talent Stack to designing you The Driven To Draw Podcast: Self Improvement|Painting|Drawing|Visual Problem Solving|Unleashing the Creativity Within! Arvind Ramkrishna/Designer/Artist/Engineer The Driven to Draw Podcast will teach you how to solve problems visually, think outside the box, build your confidence, generate ideas, and innovate.You'll hear from top creative artists, designers, engineers, and photographers who share their techniques to create products, broaden their creative abilities, and share the benefits of thinking visually.No matter your background or area of expertise, Driven to Draw will be your constant motivator to help you become your best…and Unleash the Creative Within!

Frequently Asked Questions

How long is this episode of Data Driven?

This episode is 16 minutes long.

When was this Data Driven episode published?

This episode was published on June 16, 2023.

What is this episode about?

On this episode of Data Driven, we explore the topic of distributed computing frameworks for AI and ML workloads. Frank discusses the advancements of Ray, a new technology based on Python language, with performance enhancements that could range from...

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Data Driven episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!