Skip to content
95: Data Science Pipeline Testing with Great Expectations - Abe Gong episode artwork

Nov 30, 2019 22 min

95: Data Science Pipeline Testing with Great Expectations - Abe Gong

from Test & Code Hosted by Brian Okken

Data science and machine learning are affecting more of our lives every day. Decisions based on data science and machine learning are heavily dependent on the quality of the data, and the quality of the data pipeline. Some of the software in the pipeline can be tested to some extent with traditional testing tools, like pytest. But what about the data? The data entering the pipeline, and at various stages along the pipeline, should be validated. That's where pipeline tests come in. Pipeline tests are applied to data. Pipeline tests help you guard against upstream data changes and monitor data quality. Abe Gong and Superconductive are building an open source project called Great Expectations. It's a tool to help you build pipeline tests. This is quite an interesting idea, and I hope it gains traction and takes off. Special Guest: Abe Gong. Links: Great Expectations

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

95: Data Science Pipeline Testing with Great Expectations - Abe Gong

0:00 22:49

No transcript yet.

Requests help us decide what to transcribe next.

French Your Way Jessica: Native French teacher founder of French Your Way Boost your French listening skills and test your comprehension with this one of a kind series of podcasts. Get the chance to listen to a real conversation between native speakers talking at normal speed AND customise your learning experience through carefully designed sets of questions (2 levels of difficulty) available for download at www.frenchvoicespodcast.com. All interviews also come with the transcript. French teacher Jessica interviews native speakers of French from around the world who share a bit of their life and passion. Where else would you meet in one same place a French yoga teacher based in Melbourne, a soap manufacturer from Provence, or a couple cycling around the world? Insurance Exam Queen Melissa Dillon Hi, I am Melissa, the Insurance Exam Queen. I’m the most requested Exam Prep Instructor in the U.S. and have helped thousands of people pass their Property & Casualty and Life & Health insurance exam with ease. With a long string of ONLY 5 star reviews, I’ve become known for my casual and simple teaching style, and my students love the fun memorization techniques, charts, graphs and other visual aides I use to help you understand the material. Most of my students pass their 1st or next time after going through one of my Class Series Packages. I simplify everything, tell you what to study, and even include everything from Study Notes to my own personal Practice Test to help you focus ONLY on what you need to know in order to pass the test. View my packages here: http://www.insuranceexamqueen.com Code Together Code Together Code Together is an interview series that explores challenges at the forefront of cross-architecture development. We’ll talk with those at Intel and across the industry who are forging a path on this often treacherous journey through an increasingly diverse, data-centric world. Join the conversation at oneapi.com. French Voices Podcast | Learn French | Interviews with Native French Speakers | French Culture Jessica: Native French teacher, founder of French Your Way French teacher Jessica interviews native speakers of French from around the world who share a bit of their life and passion. Learn French and boost your listening skills as you get the chance to follow a real conversation between native French people talking at normal speed AND customise your French learning experience. All interviews come with questions to test your comprehension, transcription and a list of specific French vocabulary available for free download at http://www.frenchvoicespodcast.com. Get a slice of French culture! Where else would you meet in one same place a French yoga teacher based in Melbourne, a soap manufacturer from Provence, or a couple cycling around the world? Suitable for upper intermediate and advanced students of French.

Frequently asked questions

How long is this episode of Test & Code?

This episode is 22 minutes long.

When was this Test & Code episode published?

This episode was published on November 30, 2019.

Can I download this Test & Code episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.