[SAIF2020] Day2: Natural Language Processing - Christopher Manning | Samsung
Session 1. Natural Language Processing
“Natural Language Understanding and Conversational AI”
Natural language processing (NLP) has made dramatic advances over the last three years, ranging from deep generative models for text-to-speech, such as WaveNet, through the extensive deployment of deep contextual language models, such as BERT. Pre-training with models like BERT has significantly raised the performance of almost all NLP tasks, allowed much better domain adaptation, and brought us human-level performance for tasks like answering straightforward factual questions. New neural language models have also brought much more fluent language generation. On the one hand, we should not be too impressed by these linguistic savants: Things like understanding the consequences of events in a story or performing common sense reasoning remain out of reach. But on the other hand, I will discuss how we now live in an era where there are many good commercial uses of NLP, with much of the heavy lifting already done in the construction of large but downloadable models. I present some of our work on understanding how these models learn to be so proficient, and how we can build new types of pre-trained models that are much more compute efficient. Finally, I turn to conversational agents, where neural models can produce accurate task-based dialog agents and more effective open domain social bots.
For more information, visit our websites:
- Samsung Research: http://smsng.co/sr
Видео [SAIF2020] Day2: Natural Language Processing - Christopher Manning | Samsung канала Samsung
“Natural Language Understanding and Conversational AI”
Natural language processing (NLP) has made dramatic advances over the last three years, ranging from deep generative models for text-to-speech, such as WaveNet, through the extensive deployment of deep contextual language models, such as BERT. Pre-training with models like BERT has significantly raised the performance of almost all NLP tasks, allowed much better domain adaptation, and brought us human-level performance for tasks like answering straightforward factual questions. New neural language models have also brought much more fluent language generation. On the one hand, we should not be too impressed by these linguistic savants: Things like understanding the consequences of events in a story or performing common sense reasoning remain out of reach. But on the other hand, I will discuss how we now live in an era where there are many good commercial uses of NLP, with much of the heavy lifting already done in the construction of large but downloadable models. I present some of our work on understanding how these models learn to be so proficient, and how we can build new types of pre-trained models that are much more compute efficient. Finally, I turn to conversational agents, where neural models can produce accurate task-based dialog agents and more effective open domain social bots.
For more information, visit our websites:
- Samsung Research: http://smsng.co/sr
Видео [SAIF2020] Day2: Natural Language Processing - Christopher Manning | Samsung канала Samsung
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Galaxy Buds2 Pro: Recommended by the Pros - BTS SUGA | SamsungGalaxy x BTS: A Piece of Cake 🍰: Microphone control | SamsungGalaxy S21 Series 5G: Day Epic of BTS – Portrait Mode (Full ver.) | SamsungSamsung Smart School: Korea & IndiaGalaxy S23 Ultra: Vision Booster | SamsungGalaxy x BTS: The Strange Tailor Shop 👔 | SamsungGalaxy x BTS: Unfold your world with Galaxy Z Flip4 | SamsungGalaxy S22: Astrophotography with Expert RAW | SamsungBespoke Refrigerator: Infinite Line Global Film | SamsungNew Air Purifier 3100: Introduction Video l SamsungGalaxy Buds2 Pro Expert Review: Grammy-winning mastering engineer Chris Gehringer | SamsungOdyssey OLED G9: Get ready for the next era of OLED I SamsungUltra Slim Soundbar: Looks right at home | SamsungBespoke My Life: Save energy with less effort l SamsungGalaxy S21 | S21+ 5G: 8K Video Snap (BTS ver.) | SamsungGalaxy Buds2 Pro Expert Review: Jay Versace, Chris Gehringer & Tony Maserati | SamsungNeo QLED 8K: Neural Quantum Processor 8K | SamsungGalaxy S23 Ultra: S Pen | SamsungKnox for Transportation: Take your fleet management digital with Galaxy Tablets and Knox | SamsungBespoke My Life l SamsungGalaxy S23 Ultra Photobooth with ISOCELL | Samsung