Do Transformers process sequences of FIXED or of VARIABLE length? | #AICoffeeBreakQuiz
Explaining the answer to the following AI Coffee Break Quiz question: “Do Transformers process sequences of fixed or of variable length?”
❓ Find the Quiz Question here:
https://www.youtube.com/post/UgkxuvOZ9Un4JaQXwwEzY0Vu6v753m1JoPkx
Read more:
🔗 https://huggingface.co/transformers/model_doc/bert.html
🔗 https://stats.stackexchange.com/questions/488844/self-attention-for-variable-length-sequence-classification
Outline:
00:00 The quiz question
01:26 The code
03:11 The theory
Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏
donor, Dres. Trost GbR, Yannik Schneider
➡️ AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring.com/
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔗 Links:
AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
YouTube: https://www.youtube.com/AICoffeeBreak
#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research
Music 🎵 : Seratonin from the Sun – RAGE
Видео Do Transformers process sequences of FIXED or of VARIABLE length? | #AICoffeeBreakQuiz канала AI Coffee Break with Letitia
❓ Find the Quiz Question here:
https://www.youtube.com/post/UgkxuvOZ9Un4JaQXwwEzY0Vu6v753m1JoPkx
Read more:
🔗 https://huggingface.co/transformers/model_doc/bert.html
🔗 https://stats.stackexchange.com/questions/488844/self-attention-for-variable-length-sequence-classification
Outline:
00:00 The quiz question
01:26 The code
03:11 The theory
Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏
donor, Dres. Trost GbR, Yannik Schneider
➡️ AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring.com/
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔗 Links:
AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
YouTube: https://www.youtube.com/AICoffeeBreak
#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research
Music 🎵 : Seratonin from the Sun – RAGE
Видео Do Transformers process sequences of FIXED or of VARIABLE length? | #AICoffeeBreakQuiz канала AI Coffee Break with Letitia
Показать
Комментарии отсутствуют
Информация о видео
31 октября 2021 г. 18:00:13
00:04:23
Другие видео канала
Deep Learning for Symbolic Mathematics!? | Paper EXPLAINED[Quiz] Eigenfaces, Domain adaptation, Causality, Manifold Hypothesis, Denoising Autoencoder[RANT] Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers?Our paper at CVPR 2020 - MUL Workshop and ACL 2020 - ALVR WorkshopData BAD | What Will it Take to Fix Benchmarking for NLU?Preparing for Virtual Conferences – 7 Tips for recording a good conference talkCan a neural network tell if an image is mirrored? – Visual ChiralityAI Coffee Break - Channel Trailer[Quiz] Interpretable ML, VQ-VAE w/o Quantization / infinite codebook, Pearson’s, PointCloudsWhat is the model identifiability problem? | Explained in 60 seconds! | ❓ #AICoffeeBreakQuiz #ShortsAdding vs. concatenating positional embeddings & Learned positional encodingsTransformer in Transformer: Paper explained and visualized | TNTPre-training of BERT-based Transformer architectures explained – language and vision!Training learned optimizers: VeLO paper EXPLAINEDAdversarial Machine Learning explained! | With examples.Transformer LLMs are Turing Complete after all !?Are Pre-trained Convolutions Better than Pre-trained Transformers? – Paper ExplainedFNet: Mixing Tokens with Fourier Transforms – Paper ExplainedAI understanding language!? A roadmap to natural language understanding.Transformers explained | The architecture behind LLMsWhy ChatGPT fails | Language Model Limitations EXPLAINED