Neural Networks Pt. 3: ReLU In Action!!!
The ReLU activation function is one of the most popular activation functions for Deep Learning and Convolutional Neural Networks. However, the function itself is deceptively simple. This StatQuest walks you through an example, step-by-step, that uses the ReLU activation function so you can see exactly what it does and how it works.
NOTE: This StatQuest assumes that you are already familiar with the main ideas behind Neural Networks. If not, check out the 'Quest: https://youtu.be/CqOfi41LfDw
For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/
If you'd like to support StatQuest, please consider...
Buying my book, The StatQuest Illustrated Guide to Machine Learning:
PDF - https://statquest.gumroad.com/l/wvtmc
Paperback - https://www.amazon.com/dp/B09ZCKR4H6
Kindle eBook - https://www.amazon.com/dp/B09ZG79HXC
Patreon: https://www.patreon.com/statquest
...or...
YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...a cool StatQuest t-shirt or sweatshirt:
https://shop.spreadshirt.com/statquest-with-josh-starmer/
...buying one or two of my songs (or go large and get a whole album!)
https://joshuastarmer.bandcamp.com/
...or just donating to StatQuest!
https://www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
https://twitter.com/joshuastarmer
0:00 Awesome song and introduction
1:45 ReLU in the Hidden Layer
5:35 ReLU right before the Output
7:38 The derivative of ReLU
#StatQuest #NeuralNetworks #ReLU
Видео Neural Networks Pt. 3: ReLU In Action!!! канала StatQuest with Josh Starmer
NOTE: This StatQuest assumes that you are already familiar with the main ideas behind Neural Networks. If not, check out the 'Quest: https://youtu.be/CqOfi41LfDw
For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/
If you'd like to support StatQuest, please consider...
Buying my book, The StatQuest Illustrated Guide to Machine Learning:
PDF - https://statquest.gumroad.com/l/wvtmc
Paperback - https://www.amazon.com/dp/B09ZCKR4H6
Kindle eBook - https://www.amazon.com/dp/B09ZG79HXC
Patreon: https://www.patreon.com/statquest
...or...
YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...a cool StatQuest t-shirt or sweatshirt:
https://shop.spreadshirt.com/statquest-with-josh-starmer/
...buying one or two of my songs (or go large and get a whole album!)
https://joshuastarmer.bandcamp.com/
...or just donating to StatQuest!
https://www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
https://twitter.com/joshuastarmer
0:00 Awesome song and introduction
1:45 ReLU in the Hidden Layer
5:35 ReLU right before the Output
7:38 The derivative of ReLU
#StatQuest #NeuralNetworks #ReLU
Видео Neural Networks Pt. 3: ReLU In Action!!! канала StatQuest with Josh Starmer
Показать
Комментарии отсутствуют
Информация о видео
23 ноября 2020 г. 14:05:29
00:08:58
Другие видео канала
![Essential Matrix Algebra for Neural Networks, Clearly Explained](https://i.ytimg.com/vi/ZTt9gsGcdDo/default.jpg)
![The Golden Play Button, Clearly Explained!!!’](https://i.ytimg.com/vi/rC9vw2dSpQo/default.jpg)
![Another 3 lessons from my Pop!!!](https://i.ytimg.com/vi/Ka04Dj7DxGk/default.jpg)
![What is a Logit?](https://i.ytimg.com/vi/8ZcccMzTz7Y/default.jpg)
![Logistic vs Logit Functions](https://i.ytimg.com/vi/YaQEUgIr4Mk/default.jpg)
![Attention for Neural Networks, Clearly Explained!!!](https://i.ytimg.com/vi/PSs6nxngL6k/default.jpg)
![Likelihood vs Probability](https://i.ytimg.com/vi/953NHzFtGHc/default.jpg)
![p-values](https://i.ytimg.com/vi/02zO75hHpZQ/default.jpg)
![Sequence-to-Sequence (seq2seq) Encoder-Decoder Neural Networks, Clearly Explained!!!](https://i.ytimg.com/vi/L8HKweZIOmg/default.jpg)
![Matrix Notation](https://i.ytimg.com/vi/LS6VX7noVWY/default.jpg)
![Matrix Multiplication](https://i.ytimg.com/vi/y8xRw76i1qY/default.jpg)
![The Ukulele: Clearly Explained!!!](https://i.ytimg.com/vi/ZYDN25N5WhQ/default.jpg)
![PCA Eigenvalues](https://i.ytimg.com/vi/ccjrsxXmfnw/default.jpg)
![Type 1 Errors](https://i.ytimg.com/vi/P4aYC1kS4d0/default.jpg)
![Standardized Data](https://i.ytimg.com/vi/A88rDEf-pfk/default.jpg)
![PCA Eigenvectors](https://i.ytimg.com/vi/bv9agba7blc/default.jpg)
![Type 2 Errors](https://i.ytimg.com/vi/qioNUZGVH1A/default.jpg)
![Normalized Data](https://i.ytimg.com/vi/oZ9SrkF_-LE/default.jpg)
![Word Embedding and Word2Vec, Clearly Explained!!!](https://i.ytimg.com/vi/viZrOnJclY0/default.jpg)
![The AI Buzz, Episode #5: A new wave of AI-based products and the resurgence of personal applications](https://i.ytimg.com/vi/yOJmPkyyZ18/default.jpg)
![CatBoost Part 2: Building and Using Trees](https://i.ytimg.com/vi/3Bg2XRFOTzg/default.jpg)