RI Seminar: Thomas Howard : Enabling Grounded Language Communication for Human-Robot Teaming
https://www.ri.cmu.edu/event/ri-seminar-thomas-m-howard-university-of-rochester-assistant-professor-2021-10-08/
Thomas Howard
Assistant Professor of Electrical and Computer Engineering
Electrical & Computer Engineering, University of Rochester
October 8, 2021
Enabling Grounded Language Communication for Human-Robot Teaming
Abstract: The ability for robots to effectively understand natural language instructions and convey information about their observations and interactions with the physical world is highly dependent on the sophistication and fidelity of the robot’s representations of language, environment, and actions. As we progress towards more intelligent systems that perform a wider range of tasks in a greater variety of domains, we need models that can adapt their representations of language and environment to achieve the real-time performance necessitated by the cadence of human-robot interaction within the computational resource constraints of the platform. In this talk I will review my laboratory’s research on algorithms and models for robot planning, mapping, control, and interaction with a specific focus on language-guided adaptive perception and bi-directional communication with deliberative interactive estimation.
Biosketch: Thomas Howard is an assistant professor in the Department of Electrical and Computer Engineering at the University of Rochester. He also holds secondary appointments in the Department of Biomedical Engineering and Department of Computer Science, is an affiliate of the Goergen Institute of Data Science and directs the University of Rochester’s Robotics and Artificial Intelligence Laboratory. Previously he held appointments as a research scientist and a postdoctoral associate at MIT’s Computer Science and Artificial Intelligence Laboratory in the Robust Robotics Group, a research technologist at the Jet Propulsion Laboratory in the Robotic Software Systems Group, and a lecturer in mechanical engineering at Caltech. Howard earned a PhD in robotics from the Robotics Institute at Carnegie Mellon University in 2009 in addition to BS degrees in electrical and computer engineering and mechanical engineering from the University of Rochester in 2004. His research interests span artificial intelligence, robotics, and human-robot interaction with a research focus on improving the optimality, efficiency, and fidelity of models for decision making in complex and unstructured environments with applications to robot motion planning, natural language understanding, and human-robot teaming. Howard was a member of the flight software team for the Mars Science Laboratory, the motion planning lead for the JPL/Caltech DARPA Autonomous Robotic Manipulation team, and a member of Tartan Racing, winner of the 2007 DARPA Urban Challenge. Howard has earned Best Paper Awards at RSS (2016) and IEEE SMC (2017), two NASA Group Achievement Awards (2012, 2014), was a finalist for the ICRA Best Manipulation Paper Award (2012) and was selected for the NASA Early Career Faculty Award (2019). Howard’s research at the University of Rochester has been supported by National Science Foundation, Army Research Office, Army Research Laboratory, Department of Defense Congressionally Directed Medical Research Program, National Aeronautics and Space Administration, and the New York State Center of Excellence in Data Science.
Видео RI Seminar: Thomas Howard : Enabling Grounded Language Communication for Human-Robot Teaming канала CMU Robotics Institute
Thomas Howard
Assistant Professor of Electrical and Computer Engineering
Electrical & Computer Engineering, University of Rochester
October 8, 2021
Enabling Grounded Language Communication for Human-Robot Teaming
Abstract: The ability for robots to effectively understand natural language instructions and convey information about their observations and interactions with the physical world is highly dependent on the sophistication and fidelity of the robot’s representations of language, environment, and actions. As we progress towards more intelligent systems that perform a wider range of tasks in a greater variety of domains, we need models that can adapt their representations of language and environment to achieve the real-time performance necessitated by the cadence of human-robot interaction within the computational resource constraints of the platform. In this talk I will review my laboratory’s research on algorithms and models for robot planning, mapping, control, and interaction with a specific focus on language-guided adaptive perception and bi-directional communication with deliberative interactive estimation.
Biosketch: Thomas Howard is an assistant professor in the Department of Electrical and Computer Engineering at the University of Rochester. He also holds secondary appointments in the Department of Biomedical Engineering and Department of Computer Science, is an affiliate of the Goergen Institute of Data Science and directs the University of Rochester’s Robotics and Artificial Intelligence Laboratory. Previously he held appointments as a research scientist and a postdoctoral associate at MIT’s Computer Science and Artificial Intelligence Laboratory in the Robust Robotics Group, a research technologist at the Jet Propulsion Laboratory in the Robotic Software Systems Group, and a lecturer in mechanical engineering at Caltech. Howard earned a PhD in robotics from the Robotics Institute at Carnegie Mellon University in 2009 in addition to BS degrees in electrical and computer engineering and mechanical engineering from the University of Rochester in 2004. His research interests span artificial intelligence, robotics, and human-robot interaction with a research focus on improving the optimality, efficiency, and fidelity of models for decision making in complex and unstructured environments with applications to robot motion planning, natural language understanding, and human-robot teaming. Howard was a member of the flight software team for the Mars Science Laboratory, the motion planning lead for the JPL/Caltech DARPA Autonomous Robotic Manipulation team, and a member of Tartan Racing, winner of the 2007 DARPA Urban Challenge. Howard has earned Best Paper Awards at RSS (2016) and IEEE SMC (2017), two NASA Group Achievement Awards (2012, 2014), was a finalist for the ICRA Best Manipulation Paper Award (2012) and was selected for the NASA Early Career Faculty Award (2019). Howard’s research at the University of Rochester has been supported by National Science Foundation, Army Research Office, Army Research Laboratory, Department of Defense Congressionally Directed Medical Research Program, National Aeronautics and Space Administration, and the New York State Center of Excellence in Data Science.
Видео RI Seminar: Thomas Howard : Enabling Grounded Language Communication for Human-Robot Teaming канала CMU Robotics Institute
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Computer VisionBoris Sofman, Co-Founder & CEO, ANKI : Consumer Robotics: Story and LessonsRI Seminar: Matthew Johnson-Roberson : Lessons from the Field10th Anniversary of CMU's 2007 Driverless Car : Urban ChallengeRI Seminar : Eric N. Johnson : Innovations for Unmanned AircraftMobile Robot Programming Laboratory : Course 16-362 : Fall 2013RI Seminar: Rohan Paul : Towards an Intelligence Architecture for Human-Robot TeamingRI Seminar: Chelsea Finn : Robots Should Reduce, Reuse, and RecycleRI Seminar: Red Whittaker (2008)Speck Sensor SXSW 2015 Talk : Illah Nourbakhsh Discusses Home Air MonitorrI Seminar: Chung-Wei Lin : Modeling, Design, and Analysis for Intelligent Vehicles...DARPA SUBTERRANEAN CHALLENGE : CMU + Oregon State Team1991 : The Robot Shop : CMU Robotics Institute on National Geographic ExplorerEric Horvitz : Microsoft Research : AI & Humanity Archive22 From Textures to Structures: How Computer Graphics Texturing Methods Can...Building a CMU Mission Control for Space Robotic Missions is EssentialRobotics Institute Summer Scholars (2013)Vincent Hayward : mechanics of fingertip impact on tactile and gripping functionCIVF 2012: Panel Discussion 2RI Seminar: Alec Jacobson : Geometry Processing in The Wild