Should you switch from BERT to ALBERT?
From the summaries you’ll find online, it sounds like ALBERT is both faster and more accurate than BERT--so we should probably switch over to ALBERT as our new go-to model for fine-tuning, right? In reality, if your plan is to try applying a pre-trained BERT model to your own NLP application, then you probably won’t find ALBERT to be any faster or more accurate...
In this video, we’ll make sense of this apparent contradiction, and I’ll cover the key take-aways from ALBERT, which is still a very important and fascinating model!
For a complete tutorial on ALBERT, I’ve published a ~25-page eBook here:
https://www.chrismccormick.ai/offers/HaABTJQH
Видео Should you switch from BERT to ALBERT? канала ChrisMcCormickAI
In this video, we’ll make sense of this apparent contradiction, and I’ll cover the key take-aways from ALBERT, which is still a very important and fascinating model!
For a complete tutorial on ALBERT, I’ve published a ~25-page eBook here:
https://www.chrismccormick.ai/offers/HaABTJQH
Видео Should you switch from BERT to ALBERT? канала ChrisMcCormickAI
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Applying BERT to Question Answering (SQuAD v1.1)
RoBERTa: A Robustly Optimized BERT Pretraining Approach
The first 20 hours -- how to learn anything | Josh Kaufman | TEDxCSU
ALBERT: A Lite BERT For Self-supervised Learning Of Language Representations (AI Paper Summary)
BERT Research - Ep. 1 - Key Concepts & Sources
Training BERT Language Model From Scratch On TPUs
LSTM is dead. Long Live Transformers!
Trivial BERsuiT - How much trivia does BERT know?
Topic Modeling with BERT Transformers - EXPLAINED!
How to learn any language easily | Matthew Youlden | TEDxClapham
Transformer Neural Networks - EXPLAINED! (Attention is all you need)
Data Processing For Question & Answering Systems: BERT vs. RoBERTa
NLP with Neural Networks & Transformers
An introduction to Reinforcement Learning
Text Extraction From a Corpus Using BERT (AKA Question Answering)
BERT Neural Network - EXPLAINED!
BERT Document Classification Tutorial with Code
Attention is all you need; Attentional Neural Network Models | Łukasz Kaiser | Masterclass
Subword Tokenization: Byte Pair Encoding
NLP | Fine Tuning BERT to perform Spam Classification