NLP for Developers: Shrinking Transformers | Rasa

In this video, Rasa Senior Developer Advocate Rachael will talk about different approaches to make transformer models smaller.

- "A Primer in BERTology: What we know about how BERT works" by Anna Rogers, Olga Kovaleva, Anna Rumshisky https://arxiv.org/abs/2002.12327
- Paper reading video, part 1: https://www.youtube.com/watch?v=lmeDD2PKlxg&list=PL75e0qA87dlFvomavOFBIX6S9IvtGAXjM&index=6&t=0s
- Paper reading video, part 2: https://www.youtube.com/watch?v=5d1s85TG_eY
- "Rasa Algorithm Whiteboard: Attention 4 - Transformers" https://www.youtube.com/watch?v=EXNBy8G43MM

If you want to reach out to us, feel free to leave a message at our community forum; https://forum.rasa.com/.

Видео NLP for Developers: Shrinking Transformers | Rasa канала Rasa