PyTorch Autograd Explained - In-depth Tutorial
In this PyTorch tutorial, I explain how the PyTorch autograd system works by going through some examples and visualize the graphs with diagrams. As you perform operations on PyTorch tensors that have requires_grad=True, you build up an autograd backward graph. Then when you call the backward() method on one of the output nodes, the backward graph gets traversed, starting at the node that the grad_fn attribute of the output node points to, and traversing backwards from there, accumulating gradients until leaf nodes are reached. The final leaf node gradients will be stored on the grad attribute of the leaf tensors.
This is my first PyTorch tutorial video. If you'd like to see more PyTorch related videos, let me know in the comments. And if you have anything specific about PyTorch that you would like me to make videos about, let me know.
The draw.io flowcharts shown in the video:
🔗 https://drive.google.com/file/d/1bq3akhmA5DGRCiFYJfNPSn7il2wvCkEY/view?usp=sharing
(Note: There are tabs along the bottom of the draw.io page for all the different graphs shown in the video.)
Join our Discord community:
💬 https://discord.gg/cdQhRgw
Connect with me:
🐦 Twitter - https://twitter.com/elliotwaite
📷 Instagram - https://www.instagram.com/elliotwaite
👱 Facebook - https://www.facebook.com/elliotwaite
💼 LinkedIn - https://www.linkedin.com/in/elliotwaite
🎵 ksolis - Nobody Else (https://youtu.be/RiiSXmH509c)
Видео PyTorch Autograd Explained - In-depth Tutorial канала Elliot Waite
This is my first PyTorch tutorial video. If you'd like to see more PyTorch related videos, let me know in the comments. And if you have anything specific about PyTorch that you would like me to make videos about, let me know.
The draw.io flowcharts shown in the video:
🔗 https://drive.google.com/file/d/1bq3akhmA5DGRCiFYJfNPSn7il2wvCkEY/view?usp=sharing
(Note: There are tabs along the bottom of the draw.io page for all the different graphs shown in the video.)
Join our Discord community:
💬 https://discord.gg/cdQhRgw
Connect with me:
🐦 Twitter - https://twitter.com/elliotwaite
📷 Instagram - https://www.instagram.com/elliotwaite
👱 Facebook - https://www.facebook.com/elliotwaite
💼 LinkedIn - https://www.linkedin.com/in/elliotwaite
🎵 ksolis - Nobody Else (https://youtu.be/RiiSXmH509c)
Видео PyTorch Autograd Explained - In-depth Tutorial канала Elliot Waite
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
PyTorch Hooks Explained - In-depth TutorialPyTorch at Tesla - Andrej Karpathy, TeslaWhat is Automatic Differentiation?Policy Gradient Theorem Explained - Reinforcement Learning5 Things You Should Never Do In An Automatic Transmission VehiclePyTorch Lecture 04: Back-propagation and AutogradJeremy Howard: Deep Learning Frameworks - TensorFlow, PyTorch, fast.ai | AI Podcast ClipsKeynote: Automatic Differentiation for DummiesVariational AutoencodersThe Simple Essence of Automatic Differentiation - Conal ElliottPyTorch Tutorial 03 - Gradient Calculation With Autograd"PyTorch: Fast Differentiable Dynamic Graphs in Python" by Soumith ChintalaPYTORCH COMMON MISTAKES - How To Save Time 🕒Transformer Neural Networks - EXPLAINED! (Attention is all you need)What is a kernel - Gary explainsPyTorch or TensorFlow? | 2021Python tricks: Demystifying async, await, and asyncioSuper Custom Keyboard Shortcuts with HammerspoonPaul O'Grady - An introduction to PyTorch & Autograd04 PyTorch tutorial - How do computational graphs and autograd in PyTorch work