GPT: A Technical Training Unveiled #2 - Tokenization
A demonstration of the tokenization process, detailing the conversion of text to tokens using character sets in language models. Tokenization is the process of converting a sequence of characters into a sequence of tokens. For example, given a small text data, every unique character in this text is treated as a token, leading to a vocabulary of unique characters
Wikipedia: https://en.wikipedia.org/wiki/Generative_pre-trained_transformer
Notebook: https://github.com/abdulsalam-bande/Pytorch-Neural-Network-Modules-Explained/blob/main/Mini%20Gpt%20Pretraining.ipynb
Presentation:https://github.com/abdulsalam-bande/Pytorch-Neural-Network-Modules-Explained/blob/main/Mini%20Gpt.pdf
Видео GPT: A Technical Training Unveiled #2 - Tokenization канала Machine Learning with Pytorch
Wikipedia: https://en.wikipedia.org/wiki/Generative_pre-trained_transformer
Notebook: https://github.com/abdulsalam-bande/Pytorch-Neural-Network-Modules-Explained/blob/main/Mini%20Gpt%20Pretraining.ipynb
Presentation:https://github.com/abdulsalam-bande/Pytorch-Neural-Network-Modules-Explained/blob/main/Mini%20Gpt.pdf
Видео GPT: A Technical Training Unveiled #2 - Tokenization канала Machine Learning with Pytorch
Показать
Комментарии отсутствуют
Информация о видео
9 ноября 2023 г. 14:02:21
00:10:18
Другие видео канала
torch.nn.TransformerEncoderLayer - Part 3 - Transformer Layer Normalization
GPT: A Technical Training Unveiled #6 - Block Two of Transform Decoder
GPT: A Technical Training Unveiled #7 - Final Linear Layer and Softmax
Pytorch Backpropagation With Example 01 - Forward-propagation
torch.nn.TransformerDecoderLayer - Part 4 - Multiple Linear Layers and Normalization
torch.nn.TransformerEncoderLayer - Part 5 - Transformer Encoder Second Layer Normalization
torch.nn.TransformerDecoderLayer - Part 2 - Embedding, First Multi-Head attention and Normalization
Pytorch Backpropagation With Example 02 - Backpropagation
torch.nn.TransformerDecoderLayer - Part 3 -Multi-Head attention and Normalization
Pytorch Backpropagation with Example 03 - Gradient Descent
nn.TransformerDecoderLayer - Overview
torch.nn.TransformerEncoderLayer - Part 4 - Transformer Encoder Fully Connected Layers
GPT: A Technical Training Unveiled #1 - Introduction
torch.distributions.poisson.Poisson - Poisson Distribution Guided Synthetic Data Generation
GPT: A Technical Training Unveiled #5 - Feedforward, Add & Norm
torch.nn.TransformerEncoderLayer - Part 0 - Module Overview
Self Attention with torch.nn.MultiheadAttention Module
torch.nn.Dropout exaplained
torch.nn.TransformerEncoderLayer - Part 2 - Transformer Self Attention Layer
torch.nn.Embedding - How embedding weights are updated in Backpropagation