Multilingual BERT - Part 1 - Intro and Concepts
This series will provide an introduction to some of the key concepts and techniques around applying BERT to another language, as well as example code implementations (built on PyTorch and huggingface/transformers).
In Part 1, I'll explain the difference between a "monolingual" model and a "multilingual" model (and why monolingual isn't just the obvious choice!), and introduce the concept of Cross-Lingual Transfer. I'll also describe a couple ways in which we can leverage Machine Translation.
I've also published a blog post version of this tutorial here: http://mccormickml.com/2020/10/05/multilingual-bert/
==== Playlist ====
https://www.youtube.com/playlist?list=PLam9sigHPGwM27p3FQpLK1nt0eioiM-cq
==== Receive Updates ====
Sign up to hear about new content across my blog and channel: https://www.chrismccormick.ai/subscribe
Видео Multilingual BERT - Part 1 - Intro and Concepts канала ChrisMcCormickAI
In Part 1, I'll explain the difference between a "monolingual" model and a "multilingual" model (and why monolingual isn't just the obvious choice!), and introduce the concept of Cross-Lingual Transfer. I'll also describe a couple ways in which we can leverage Machine Translation.
I've also published a blog post version of this tutorial here: http://mccormickml.com/2020/10/05/multilingual-bert/
==== Playlist ====
https://www.youtube.com/playlist?list=PLam9sigHPGwM27p3FQpLK1nt0eioiM-cq
==== Receive Updates ====
Sign up to hear about new content across my blog and channel: https://www.chrismccormick.ai/subscribe
Видео Multilingual BERT - Part 1 - Intro and Concepts канала ChrisMcCormickAI
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Multilingual BERT - Part 2 - XLM-R's Vocabulary
Transformers, explained: Understand the model behind GPT, BERT, and T5
BERT Neural Network - EXPLAINED!
Should you switch from BERT to ALBERT?
Language Processing with BERT: The 3 Minute Intro (Deep learning for NLP)
Vision Transformer for Image Classification
NLP for Developers: Multilingual NLP | Rasa
Multilingual BERT - Part 3 - Multi vs. Monolingual on XNLI
Sentiment Analysis with BERT Neural Network and Python
HNSW for Vector Search Explained and Implemented with Faiss (Python)
All You Need to Know on Multilingual Sentence Vectors (1 Model, 50+ Languages)
BERT Research - Ep. 1 - Key Concepts & Sources
What is BERT? | Deep Learning Tutorial 46 (Tensorflow, Keras & Python)
Set-up a custom BERT Tokenizer for any language
Thomas Wolf (HuggingFace): An Introduction to Transfer Learning and HuggingFace
Part of Speech Tagging : Natural Language Processing
Extract Word Embedding & Sentence Embeddings from Text data using BERT
Deep Learning Project: Text Generation using Recurrent Neural Networks (RNNs) & Transformers in NLP
Subword Tokenization: Byte Pair Encoding