Can a language model (like GPT-3) learn meaning? But really?
What is meaning? How far is state-of-the art NLP from meaning? Do publications misuse the word “meaning”?
"Climbing towards NLU" paper explained.
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 Transformer combining Vision and Language: https://youtu.be/dd7nE4nbxN0
📺 GPT-3 video: https://youtu.be/5fqxPOaaqi0
📺 BERTology meets Biology: https://youtu.be/pFf4PltQ9LY
Outline:
* 00:00 500 subs celebration!
* 00:53 Breathing pause
* 02:12 Misuse of “meaning”
* 04:22 What is meaning?
* 06:39 Language models and meaning
* 08:20 Octopus experiment
* 11:09 What to do?
📄 Paper explained: Bender, Emily M., and Alexander Koller. "Climbing towards NLU: On meaning, form, and understanding in the age of data." In Proc. of ACL. 2020. https://www.aclweb.org/anthology/2020.acl-main.463/
🎧 Audiopaper: https://soundcloud.com/emily-m-bender/climbingtowardsnlu-audiopaper/s-0ZT7112K1Ep
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #ACL2020 #NLU
Video and thumbnail contain emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Видео Can a language model (like GPT-3) learn meaning? But really? канала AI Coffee Break with Letitia
"Climbing towards NLU" paper explained.
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 Transformer combining Vision and Language: https://youtu.be/dd7nE4nbxN0
📺 GPT-3 video: https://youtu.be/5fqxPOaaqi0
📺 BERTology meets Biology: https://youtu.be/pFf4PltQ9LY
Outline:
* 00:00 500 subs celebration!
* 00:53 Breathing pause
* 02:12 Misuse of “meaning”
* 04:22 What is meaning?
* 06:39 Language models and meaning
* 08:20 Octopus experiment
* 11:09 What to do?
📄 Paper explained: Bender, Emily M., and Alexander Koller. "Climbing towards NLU: On meaning, form, and understanding in the age of data." In Proc. of ACL. 2020. https://www.aclweb.org/anthology/2020.acl-main.463/
🎧 Audiopaper: https://soundcloud.com/emily-m-bender/climbingtowardsnlu-audiopaper/s-0ZT7112K1Ep
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #ACL2020 #NLU
Video and thumbnail contain emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Видео Can a language model (like GPT-3) learn meaning? But really? канала AI Coffee Break with Letitia
Показать
Комментарии отсутствуют
Информация о видео
20 августа 2020 г. 16:30:02
00:12:47
Другие видео канала
GPT-3 explained with examples. Possibilities, and implications.The benefits of a bilingual brain - Mia NacamulliMasked Autoencoders Are Scalable Vision Learners – Paper explained and animated!What GPT-3 Means for DevelopersOpenAI GPT-3 - Good At Almost Everything! 🤖AI Language Models & Transformers - ComputerphileGPT-3 is over-hyped | George Hotz and Lex FridmanSEER explained: Vision Models more Robust & Fair when pretrained on UNCURATED images!?GPT-3 vs Human BrainIs AI a species-level threat to humanity? | Elon Musk, Michio Kaku, Steven Pinker & more | Big ThinkPaLM Pathways Language Model explained | 540 Billion parameters can explain jokes!?GPT 3 Demo and Explanation - An AI revolution from OpenAINLP for Developers: GPT-3 | RasaIs OpenAI still open?Your personality and your brain | Scott Schwefel | TEDxBrookingsComputer science is for everyone | Hadi Partovi | TEDxRainierGPT3 - Will AI replace programmers?Schizophrenia - causes, symptoms, diagnosis, treatment & pathologyOpenAI's New Language Generator: GPT-3 | This AI Generates Code, Websites, Songs & More From Words