Tutorial 14- Stochastic Gradient Descent with Momentum
In this post I’ll talk about simple addition to classic SGD algorithm, called momentum which almost always works better and faster than Stochastic Gradient Descent. Momentum or SGD with momentum is method which helps accelerate gradients vectors in the right directions, thus leading to faster converging. It is one of the most popular optimization algorithms and many state-of-the-art models are trained using it. Before jumping over to the update equations of the algorithm, let’s look at some math that underlies the work of momentum.
Below are the various playlist created on ML,Data Science and Deep Learning. Please subscribe and support the channel. Happy Learning!
Deep Learning Playlist: https://www.youtube.com/watch?v=DKSZHN7jftI&list=PLZoTAELRMXVPGU70ZGsckrMdr0FteeRUi
Data Science Projects playlist: https://www.youtube.com/watch?v=5Txi0nHIe0o&list=PLZoTAELRMXVNUcr7osiU7CCm8hcaqSzGw
NLP playlist: https://www.youtube.com/watch?v=6ZVf1jnEKGI&list=PLZoTAELRMXVMdJ5sqbCK2LiM0HhQVWNzm
Statistics Playlist: https://www.youtube.com/watch?v=GGZfVeZs_v4&list=PLZoTAELRMXVMhVyr3Ri9IQ-t5QPBtxzJO
Feature Engineering playlist: https://www.youtube.com/watch?v=NgoLMsaZ4HU&list=PLZoTAELRMXVPwYGE2PXD3x0bfKnR0cJjN
Computer Vision playlist: https://www.youtube.com/watch?v=mT34_yu5pbg&list=PLZoTAELRMXVOIBRx0andphYJ7iakSg3Lk
Data Science Interview Question playlist: https://www.youtube.com/watch?v=820Qr4BH0YM&list=PLZoTAELRMXVPkl7oRvzyNnyj1HS4wt2K-
You can buy my book on Finance with Machine Learning and Deep Learning from the below url
amazon url: https://www.amazon.in/Hands-Python-Finance-implementing-strategies/dp/1789346371/ref=sr_1_1?keywords=krish+naik&qid=1560943725&s=gateway&sr=8-1
🙏🙏🙏🙏🙏🙏🙏🙏
YOU JUST NEED TO DO
3 THINGS to support my channel
LIKE
SHARE
&
SUBSCRIBE
TO MY YOUTUBE CHANNEL
Видео Tutorial 14- Stochastic Gradient Descent with Momentum канала Krish Naik
Below are the various playlist created on ML,Data Science and Deep Learning. Please subscribe and support the channel. Happy Learning!
Deep Learning Playlist: https://www.youtube.com/watch?v=DKSZHN7jftI&list=PLZoTAELRMXVPGU70ZGsckrMdr0FteeRUi
Data Science Projects playlist: https://www.youtube.com/watch?v=5Txi0nHIe0o&list=PLZoTAELRMXVNUcr7osiU7CCm8hcaqSzGw
NLP playlist: https://www.youtube.com/watch?v=6ZVf1jnEKGI&list=PLZoTAELRMXVMdJ5sqbCK2LiM0HhQVWNzm
Statistics Playlist: https://www.youtube.com/watch?v=GGZfVeZs_v4&list=PLZoTAELRMXVMhVyr3Ri9IQ-t5QPBtxzJO
Feature Engineering playlist: https://www.youtube.com/watch?v=NgoLMsaZ4HU&list=PLZoTAELRMXVPwYGE2PXD3x0bfKnR0cJjN
Computer Vision playlist: https://www.youtube.com/watch?v=mT34_yu5pbg&list=PLZoTAELRMXVOIBRx0andphYJ7iakSg3Lk
Data Science Interview Question playlist: https://www.youtube.com/watch?v=820Qr4BH0YM&list=PLZoTAELRMXVPkl7oRvzyNnyj1HS4wt2K-
You can buy my book on Finance with Machine Learning and Deep Learning from the below url
amazon url: https://www.amazon.in/Hands-Python-Finance-implementing-strategies/dp/1789346371/ref=sr_1_1?keywords=krish+naik&qid=1560943725&s=gateway&sr=8-1
🙏🙏🙏🙏🙏🙏🙏🙏
YOU JUST NEED TO DO
3 THINGS to support my channel
LIKE
SHARE
&
SUBSCRIBE
TO MY YOUTUBE CHANNEL
Видео Tutorial 14- Stochastic Gradient Descent with Momentum канала Krish Naik
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![Tutorial 15- Adagrad Optimizers in Neural Network](https://i.ytimg.com/vi/GSmW59dM0-o/default.jpg)
![](https://i.ytimg.com/vi/vGTSUY11ol4/default.jpg)
![How Gradient Descent Works. Simple Explanation](https://i.ytimg.com/vi/Gbz8RljxIHo/default.jpg)
![Tutorial 12- Stochastic Gradient Descent vs Gradient Descent](https://i.ytimg.com/vi/FpDsDn-fBKA/default.jpg)
![Gradient Descent with Momentum and Nesterov's Accelerated Gradient](https://i.ytimg.com/vi/dL9GNk5uJfc/default.jpg)
![](https://i.ytimg.com/vi/zpgYGji8au4/default.jpg)
![Accelerate Gradient Descent with Momentum (in 3 minutes)](https://i.ytimg.com/vi/iudXf5n_3ro/default.jpg)
![Tutorial 13- Global Minima and Local Minima in Depth Understanding](https://i.ytimg.com/vi/JLk0ee_zuOM/default.jpg)
![Momentum Optimizer in Deep Learning | Explained in Detail](https://i.ytimg.com/vi/Vce8w1sy0e8/default.jpg)
![Gradient Descent With Momentum (C2W2L06)](https://i.ytimg.com/vi/k8fTYJPd3_I/default.jpg)
![Stochastic gradient descent explained | Stochastic gradient descent vs Gradient descent|Mini batch](https://i.ytimg.com/vi/7QzNifIDXDw/default.jpg)
![Stochastic Gradient Descent, Clearly Explained!!!](https://i.ytimg.com/vi/vMh0zPT0tLI/default.jpg)
![Gradient Descent, Step-by-Step](https://i.ytimg.com/vi/sDv4f4s2SB8/default.jpg)
![Tutorial 20- Convolution Neural Network vs Human Brain](https://i.ytimg.com/vi/cleLMnmNMpY/default.jpg)
![Live Day 4- Advance Statistics With Python In Data Science](https://i.ytimg.com/vi/xTLfLtqGsyg/default.jpg)
![Stochastic Gradient Descent vs Batch Gradient Descent vs Mini Batch Gradient Descent |DL Tutorial 14](https://i.ytimg.com/vi/IU5fuoYBTAM/default.jpg)
![73 - Image Segmentation using U-Net - Part1 (What is U-net?)](https://i.ytimg.com/vi/azM57JuQpQI/default.jpg)
![Live Day 7- Summarizing Statistics With Python In Data Science](https://i.ytimg.com/vi/xKCrCyJV9Os/default.jpg)
![Gradient Descent With Momentum| Complete Intuition & Mathematics|](https://i.ytimg.com/vi/WyAZ97igZxA/default.jpg)
![134 - What are Optimizers in deep learning? (Keras & TensorFlow)](https://i.ytimg.com/vi/JhQqquVeCE0/default.jpg)