Neural Network from Scratch | Mathematics & Python Code
In this video we'll see how to create our own Machine Learning library, like Keras, from scratch in Python. The goal is to be able to create various neural network architectures in a lego-fashion way. We'll see how we should architecture the code so that we can create one class per layer. We will go through the mathematics of every layer that we implement, namely the Dense or Fully Connected layer, and the Activation layer.
😺 GitHub: https://github.com/TheIndependentCode/Neural-Network
🐦 Twitter: https://twitter.com/omar_aflak
Same content in an article: https://towardsdatascience.com/math-neural-network-from-scratch-in-python-d6da9f29ce65
Chapters:
00:00 Intro
01:09 The plan
01:56 ML Reminder
02:51 Implementation Design
06:40 Base Layer Code
07:55 Dense Layer Forward
10:42 Dense Layer Backward Plan
11:23 Dense Layer Weights Gradient
14:59 Dense Layer Bias Gradient
16:28 Dense Layer Input Gradient
18:22 Dense Layer Code
19:43 Activation Layer Forward
20:46 Activation Layer Input Gradient
22:30 Hyperbolic Tangent
23:24 Mean Squared Error
26:05 XOR Intro
27:04 Linear Separability
27:45 XOR Code
30:32 XOR Decision Boundary
====
Animation framework from @3Blue1Brown : https://github.com/3b1b/manim
Видео Neural Network from Scratch | Mathematics & Python Code канала The Independent Code
😺 GitHub: https://github.com/TheIndependentCode/Neural-Network
🐦 Twitter: https://twitter.com/omar_aflak
Same content in an article: https://towardsdatascience.com/math-neural-network-from-scratch-in-python-d6da9f29ce65
Chapters:
00:00 Intro
01:09 The plan
01:56 ML Reminder
02:51 Implementation Design
06:40 Base Layer Code
07:55 Dense Layer Forward
10:42 Dense Layer Backward Plan
11:23 Dense Layer Weights Gradient
14:59 Dense Layer Bias Gradient
16:28 Dense Layer Input Gradient
18:22 Dense Layer Code
19:43 Activation Layer Forward
20:46 Activation Layer Input Gradient
22:30 Hyperbolic Tangent
23:24 Mean Squared Error
26:05 XOR Intro
27:04 Linear Separability
27:45 XOR Code
30:32 XOR Decision Boundary
====
Animation framework from @3Blue1Brown : https://github.com/3b1b/manim
Видео Neural Network from Scratch | Mathematics & Python Code канала The Independent Code
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Convolutional Neural Network from Scratch | Mathematics & Python CodeDistilling the Knowledge in a Neural NetworkCreate a Simple Neural Network in Python from ScratchHow convolutional neural networks work, in depthBut what is a neural network? | Chapter 1, Deep learningPredicting Crypto Prices in PythonArduino Neural Network Robot - Complete How-To!Building a neural network FROM SCRATCH (no Tensorflow/Pytorch, just numpy & math)Gradient descent, how neural networks learn | Chapter 2, Deep learningNeural Networks Explained from Scratch using PythonNeural network racing cars around a trackGroup theory, abstraction, and the 196,883-dimensional monsterNeural Network Python Project - Handwritten Digit RecognitionA.I. teaches itself to drive in TrackmaniaHow to build a Simple Neural Network in Python (One Layer) Part IMachine Learning with JAX - From Zero to Hero | Tutorial #12020's Biggest Breakthroughs in Math and Computer ScienceWhy neural networks aren't neural networksThe Mathematics of Neural Networks2. EEG classification using deep 1D convolutional neural network