Thinking on your Feet: Reinforcement Learning for Incremental Language Tasks
Yandex School of Data Analysis Conference
Machine Learning: Prospects and Applications
https://yandexdataschool.com/conference
In this talk, I’ll discuss two real-world language applications that require “thinking on your feet”: synchronous machine translation (or “machine si- multaneous interpretation”) and question answering (when questions are revealed one piece at a time). In both cases, effective algorithms for these tasks must interrupt the input stream and decide when to provide output.
Synchronous machine translation is when a sentence is being produced one word at a time in a foreign language and we want to produce a translation in English simultaneously (i.e., with as little delay between a foreign language word and its English translation). This is particularly dif- ficult in verb-final languages like German or Japanese, where an English translation can barely begin until the verb is seen. Effective translation thus requires predictions of unseen elements of the sentence (e.g., the main verb in German and Japanese, or relative clauses in Japanese, or post-positions in Japanese). We use reinforcement learning to decide when to trust our verb predictions. It must learn to balance incorrect translation versus timely translations, and must use those predictions to translate the sentence.
For question answering, we use a specially designed dataset that chal- lenges humans: a trivia game called quiz bowl. These questions are writ- ten so that they can be interrupted by someone who knows more about the answer; that is, harder clues are at the start of the question and easier clues are at the end of the question. We create a recursive neural network to predict answers from incomplete questions and use reinforcement learning to decide when to guess. We are able to answer questions earlier in the questions than most college trivia contestants.
This talk covers three papers presented at the Empirical Methods in Natu- ral Language Processing conference.
Видео Thinking on your Feet: Reinforcement Learning for Incremental Language Tasks канала Компьютерные науки
Machine Learning: Prospects and Applications
https://yandexdataschool.com/conference
In this talk, I’ll discuss two real-world language applications that require “thinking on your feet”: synchronous machine translation (or “machine si- multaneous interpretation”) and question answering (when questions are revealed one piece at a time). In both cases, effective algorithms for these tasks must interrupt the input stream and decide when to provide output.
Synchronous machine translation is when a sentence is being produced one word at a time in a foreign language and we want to produce a translation in English simultaneously (i.e., with as little delay between a foreign language word and its English translation). This is particularly dif- ficult in verb-final languages like German or Japanese, where an English translation can barely begin until the verb is seen. Effective translation thus requires predictions of unseen elements of the sentence (e.g., the main verb in German and Japanese, or relative clauses in Japanese, or post-positions in Japanese). We use reinforcement learning to decide when to trust our verb predictions. It must learn to balance incorrect translation versus timely translations, and must use those predictions to translate the sentence.
For question answering, we use a specially designed dataset that chal- lenges humans: a trivia game called quiz bowl. These questions are writ- ten so that they can be interrupted by someone who knows more about the answer; that is, harder clues are at the start of the question and easier clues are at the end of the question. We create a recursive neural network to predict answers from incomplete questions and use reinforcement learning to decide when to guess. We are able to answer questions earlier in the questions than most college trivia contestants.
This talk covers three papers presented at the Empirical Methods in Natu- ral Language Processing conference.
Видео Thinking on your Feet: Reinforcement Learning for Incremental Language Tasks канала Компьютерные науки
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Comparing Incremental Learning Strategies for Convolutional Neural NetworksKarthik Narasimhan: Navigating Natural Language Using Reinforcement LearningGary Smith & David Barrett - Trading Solos "Thinking On Your Feet"The Real Reason to be Afraid of Artificial Intelligence | Peter Haas | TEDxDirigoMohammad Norouzi on sequence prediction meets reinforcement learningHow To Think Better And Faster On Your FeetRL Course by David Silver - Lecture 1: Introduction to Reinforcement LearningIntrinsically Motivated Goal Exploration, Automated Curriculum Learning and Emergence of Tool UseCommskills Group Think on Your Feet SpeechAn Introduction to Machine Translationnoam chomsky's linguistic theory for language acquisition8 Hot Dog Gadgets put to the TestДень открытых дверей в Школе анализа данных Яндекс 2019 - Прямая трансляцияMarI/O - Machine Learning for Video GamesReinforcement Learning - Ep. 30 (Deep Learning SIMPLIFIED)Lecture 17.5 — Large Scale Machine Learning | Online Learning — [ Machine Learning | Andrew Ng ]Lecture 10: Reinforcement LearningVirtual agent with Deep reinforcement learningNeural Network Fundamentals (Part1): Input and OutputFrom Facebook AI research - Soumith Chintala - Adversarial Networks