Multilingual BERT - Part 3 - Multi vs. Monolingual on XNLI
In Part 3, I'll walk you through some code for applying BERT-like models to Arabic.
We'll start by applying XLM-R (a multilingual model), and using the technique of Cross-Lingual Transfer.
Then, for comparison, we'll look through a second Notebook where I've applied a monolingual Arabic BERT model, and augmented its training data using machine-translated text.
If you'd like a copy of these two Notebooks, they're available to purchase from my site here:
https://www.chrismccormick.ai/multilingual-models?utm_source=youtube&utm_medium=vid_desc&utm_campaign=bert_mulitlingual&utm_content=vid6
==== Receive Updates ====
Sign up to hear about new content across my blog and channel: https://www.chrismccormick.ai/subscribe
Видео Multilingual BERT - Part 3 - Multi vs. Monolingual on XNLI канала ChrisMcCormickAI
We'll start by applying XLM-R (a multilingual model), and using the technique of Cross-Lingual Transfer.
Then, for comparison, we'll look through a second Notebook where I've applied a monolingual Arabic BERT model, and augmented its training data using machine-translated text.
If you'd like a copy of these two Notebooks, they're available to purchase from my site here:
https://www.chrismccormick.ai/multilingual-models?utm_source=youtube&utm_medium=vid_desc&utm_campaign=bert_mulitlingual&utm_content=vid6
==== Receive Updates ====
Sign up to hear about new content across my blog and channel: https://www.chrismccormick.ai/subscribe
Видео Multilingual BERT - Part 3 - Multi vs. Monolingual on XNLI канала ChrisMcCormickAI
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Multilingual BERT - Part 1 - Intro and ConceptsSmart Batching Tutorial - Speed Up BERT Training!Bilingual and monolingual baby brains differ in response to languageDeep Learning for Natural Language ProcessingThe Mystery of Fast-5 and D.I.E.T.: Bert Herring, MD at TEDxRiversideAvondaleNatural Language Processing (NLP) and Cross-Lingual Model (XLM) LectureBERT Research - Ep. 1 - Key Concepts & SourcesWord Embeddings with BERT - Kaggle Nlp Real or Not? text classification competition Part 2Advanced NLP Tutorial for Text Classification with Hugging Face Transformers (DistilBERT) and ktrainUsing spaCy with Bert in PyTorch | Hugging Face Transformers | Matthew HonnibalNLP for Developers: BERT | RasaAlternative for non-english NLP: XLM-RoBERTa - AI Suisse | Apr 2020Simple Transformers Test Drive - Ep. 3 - Best Checkpoint StrategyColab GPU Benchmarks for Fine-Tuning BERTShould you switch from BERT to ALBERT?CMU Multilingual NLP 2020 (10): Multilingual Training and Cross-lingual TransferMultilingual NLP:#9 | Real Example - Named Entity Recognition using Pretrained Language ModelsDisaster Tweets Classification with Deep Learning and BERT in PythonNLP | Fine Tuning BERT to perform Spam ClassificationHow Similar are Persian and Arabic?