Skip to content
[TRENDS] Foundation Models episode artwork

Dec 14, 2022 16 min

[TRENDS] Foundation Models

from The Art of A.I. Hosted by Jerry Cuomo

Now Live! This special *trends* episode is on Foundation Models. Listen in as host Jerry Cuomo is joined by fellow IBM Consulting Fellow, Blaine Dolph, for a discussion on this exciting emerging trend in artificial intelligence. Blaine provides a definition of Foundation Models including what makes them a breakthrough worth paying attention to in the months to come. Jerry and Blaine share several examples using the OpenAI playground, and with a little help from Digital Jerry (DJ), demonstrate how these models can be applied to automate aspects of your everyday work life. Blaine discusses how early examples of models, like GPT-3, BERT, or DALL-E 2, have shown what’s possible. Input a short prompt, and the system generates an entire essay, or a complex image, based on your parameters, even if it wasn’t specifically trained on how to execute that exact argument or generate an image in that way. What exactly is a foundation model, you ask? A foundation model is a deep learning algorithm that has been pre-trained with extremely large data sets. In many cases the data is scraped from the public internet including Wikipedia and GitHub. Unlike narrow artificial intelligence (narrow AI) models that are trained to perform a single task, foundation models are trained with a wide variety of data and can transfer knowledge from one task to another. This type of large-scale neural network can be trained once and then fine-tuned to complete different types of tasks. Foundation models contain hundreds of billions of hyperparameters that have been trained with hundreds of gigabytes of data. Once completed, however, each foundation model can be modified an unlimited number of times to automate a wide variety of discrete tasks.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

[TRENDS] Foundation Models

0:00 16:52

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of The Art of A.I.?

This episode is 16 minutes long.

When was this The Art of A.I. episode published?

This episode was published on December 14, 2022.

Can I download this The Art of A.I. episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.