EPISODE · Jun 30, 2017 · 15 MIN
[MINI] The Vanishing Gradient
from Data Skeptic
This episode discusses the vanishing gradient - a problem that arises when training deep neural networks in which nearly all the gradients are very close to zero by the time back-propagation has reached the first hidden layer. This makes learning virtually impossible without some clever trick or improved methodology to help earlier layers begin to learn.
NOW PLAYING
[MINI] The Vanishing Gradient
No transcript for this episode yet
Similar Episodes
Jun 20, 2026 ·2m
Jun 15, 2026 ·3m
Jun 14, 2026 ·2m
Jun 13, 2026 ·3m
Jun 12, 2026 ·3m
Jun 11, 2026 ·3m