Introduction to Deep Learning : Attention Mechanism

This video explains the basic structure of the neural network, Attention.
It has recently been very popularly used in Deep Learning alongside Convolutional Neural Networks.

Previous :Downsizing Neural Networks by Quantization
https://youtu.be/DDelqfkYCuo

Basics of Designing Neural Network
https://youtu.be/CEutOy7kGx4

The Mechanism of Neural Network Training
https://youtu.be/aIVa86cwjco

What are Recurrent Neural Networks?(RNN)
https://youtu.be/d1WQK2b9k-w

Understanding LSTM without Mathematical Expressions (Long Short-Term Memory)
https://youtu.be/Ox4suDoUCGQ

Playlist : Introduction to Deep Learning
https://www.youtube.com/playlist?list=PLg1wtJlhfh23KxT90XrswtrBhBtP_rc53

Neural Network Console
https://dl.sony.com/

Neural Network Libraries
https://nnabla.org/

Squeeze-and-Excitation Networks
Jie Hu, Li Shen, Samuel Albanie, Gang Sun, Enhua Wu
https://arxiv.org/abs/1709.01507

Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
https://arxiv.org/abs/1706.03762

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
https://arxiv.org/abs/1810.04805

**NOTE**
This contents has been translated from Japanese into English.
The original has been published on January 23, 2020.
https://youtu.be/g5DSLeJozdw

Видео Introduction to Deep Learning : Attention Mechanism канала Neural Network Console