EPISODE · Mar 29, 2017 · 53 MIN
How to Do Linear Regression using Gradient Descent
from Siraj Raval
The point of this is to demonstrate the concept of gradient descent. Gradient descent is the most popular optimization strategy in deep learning, in particular an implementation of it called backpropagation. We are using gradient descent as our optimization strategy for linear regression. We'll draw the line of best fit to measure the relationship between student test scores and the amount of hours studied. Code for this video: https://github.com/llSourcell/linear_regression_live Yes, I've done this video before. But I'm doing it again because 1. Gradient Descent is really important. Know how it works. 2. Last time was in Google Hangouts (Ghetto) this is better quality More learning resources: https://spin.atomicobject.com/2014/06/24/gradient-descent-linear-regression/ https://en.wikipedia.org/wiki/Gradient_descent http://machinelearningmastery.com/gradient-descent-for-machine-learning/ https://www.analyticsvidhya.com/blog/2017/03/introduction-to-gradient-descent-algorithm-along-its-variants/ http://ufldl.stanford.edu/tutorial/supervised/OptimizationStochasticGradientDescent/ Join us in the Wizards Slack Channel: http://wizards.herokuapp.com/ Please Subscribe! And like. And comment. That's what keeps me going. And please support me on Patreon: https://www.patreon.com/user?u=3191693 Follow me: Twitter: https://twitter.com/sirajraval Facebook: https://www.facebook.com/sirajology Instagram: https://www.instagram.com/sirajraval/
What this episode covers
The point of this is to demonstrate the concept of gradient descent. Gradient descent is the most popular optimization strategy in deep learning, in particular an implementation of it called backpropagation. We are using gradient descent as our optimization strategy for linear regression. We'll draw the line of best fit to measure the relationship between student test scores and the amount of hours studied. Code for this video: https://github.com/llSourcell/linear_regression_live Yes, I've done this video before. But I'm doing it again because 1. Gradient Descent is really important. Know how it works. 2. Last time was in Google Hangouts (Ghetto) this is better quality More learning resources: https://spin.atomicobject.com/2014/06/24/gradient-descent-linear-regression/ https://en.wikipedia.org/wiki/Gradient_descent http://machinelearningmastery.com/gradient-descent-for-machine-learning/ https://www.analyticsvidhya.com/blog/2017/03/introduction-to-gradient-descent-algorithm-along-its-variants/ http://ufldl.stanford.edu/tutorial/supervised/OptimizationStochasticGradientDescent/ Join us in the Wizards Slack Channel: http://wizards.herokuapp.com/ Please Subscribe! And like. And comment. That's what keeps me going. And please support me on Patreon: https://www.patreon.com/user?u=3191693 Follow me: Twitter: https://twitter.com/sirajraval Facebook: https://www.facebook.com/sirajology Instagram: https://www.instagram.com/sirajraval/
NOW PLAYING
How to Do Linear Regression using Gradient Descent
No transcript for this episode yet