Skip to content
Modin: Pandas Scalability with Devin Petersohn episode artwork

Jul 23, 2020 55 min

Modin: Pandas Scalability with Devin Petersohn

from Software Engineering Daily Hosted by softwareengineeringdaily.com

Pandas is a Python data analysis library, and an essential tool in data science. Pandas allows users to load large quantities of data into a data structure called a dataframe, over which the user can call mathematical operations. When the data fits entirely into memory this works well, but sometimes there is too much data for a single box. The Modin project scales Pandas workflows to multiple machines by utilizing Dask or Ray, which are distributed computing primitives for Python programs. Modin builds an execution plan for large data frames to be operated on against each other, which makes data science considerably easier for these large data sets. Devin Petersohn started the Modin project, and he joins the show to talk about data science with Python, and his work in the Berkeley RISELab.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Modin: Pandas Scalability with Devin Petersohn

0:00 55:45

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Software Engineering Daily?

This episode is 55 minutes long.

When was this Software Engineering Daily episode published?

This episode was published on July 23, 2020.

Can I download this Software Engineering Daily episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.