Skip to content
Laurence Aitchison: Deep kernel machines episode artwork

Feb 3, 2022 52 min

Laurence Aitchison: Deep kernel machines

from Finnish Center for Artificial Intelligence FCAI Hosted by DASER

Deep neural networks (DNNs) with the flexibility to learn good top-layer representations have eclipsed shallow kernel methods without that flexibility. Here, we take inspiration from DNNs to develop the deep kernel machine. Optimizing the deep kernel machine objective is equivalent to exact inference in an infinitely wide Bayesian neural network or deep Gaussian process, which has been scaled carefully to retain representation learning. We conjecture that the deep kernel machine objective is unimodal, and give a proof of unimodality for linear kernels. We describe a fast optimizer that uses the Continuous Algebraic Ricatti Equations from control theory to converge in ~10 steps, and we show superior predictive performance over alternative approaches to learning the kernel.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Laurence Aitchison: Deep kernel machines

0:00 52:38

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Finnish Center for Artificial Intelligence FCAI?

This episode is 52 minutes long.

When was this Finnish Center for Artificial Intelligence FCAI episode published?

This episode was published on February 3, 2022.

Can I download this Finnish Center for Artificial Intelligence FCAI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.