I talk to the new Facebook Blender Chatbot
This is what a 9 Billion parameter transformer can do. I take a look at FAIR's new paper "Recipes for building an open-domain chatbot" and try out their chatbot live!
Jump to 3:00 to see the chatbot in action.
Paper: https://arxiv.org/abs/2004.13637
Blog: https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
Code: https://parl.ai/projects/blender/
Abstract:
Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, and displaying knowledge, empathy and personality appropriately, while maintaining a consistent persona. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter models, and make our models and code publicly available under the collective name Blender. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.
Authors: Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric M. Smith, Y-Lan Boureau, Jason Weston
Links:
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
BitChute: https://www.bitchute.com/channel/yannic-kilcher
Minds: https://www.minds.com/ykilcher
Видео I talk to the new Facebook Blender Chatbot канала Yannic Kilcher
Jump to 3:00 to see the chatbot in action.
Paper: https://arxiv.org/abs/2004.13637
Blog: https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
Code: https://parl.ai/projects/blender/
Abstract:
Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, and displaying knowledge, empathy and personality appropriately, while maintaining a consistent persona. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter models, and make our models and code publicly available under the collective name Blender. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.
Authors: Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric M. Smith, Y-Lan Boureau, Jason Weston
Links:
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
BitChute: https://www.bitchute.com/channel/yannic-kilcher
Minds: https://www.minds.com/ykilcher
Видео I talk to the new Facebook Blender Chatbot канала Yannic Kilcher
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
The Seven People Who Can Turn Off the InternetComo VENDER AUTOMÁTICAMENTE en Facebook 💙 CHATBOT para Messenger y Marketplace de Facebook (FÁCIL)TransCoder: Unsupervised Translation of Programming Languages (Paper Explained)Facebook AI Chatbot in ExcelA teaching assistant named Jill Watson | Ashok Goel | TEDxSanFranciscoDeep Networks Are Kernel Machines (Paper Explained)How to Become a Big Tech BillionaireGoogle's new chatbot "Meena": the most human-like AI chatbot ever 🤖Feature Visualization & The OpenAI microscopeBuild Facebook's Blender Bot chatbot on Ubuntu 20.04 part 1 until my system crashes ;)Language Models are Open Knowledge Graphs (Paper Explained)ReBeL - Combining Deep Reinforcement Learning and Search for Imperfect-Information Games (Explained)5 Scary Chatbots to NEVER Chat WithThe danger of AI is weirder than you think | Janelle ShaneBackpropagation and the brainPrecision! - Evidence for Ancient High Technology, part 2Intelligent AI Chatbot in PythonLongformer: The Long-Document Transformer🤖 Make Money With ChatBots! [Passive Income]Google’s Chatbot: Almost Perfect 🤖