Robot Dance Generation based on Music Analysis Driven Trajectory Optimization
Authors: Melya Boukheddimi, Daniel Harnack, Shivesh Kumar, Rohit Kumar, Shubham Vyas, Octavio Arriaga, and Frank Kirchner
Musical dancing is an ubiquitous phenomenon in human society. Providing robots the ability to dance has the potential to make the human robot co-existence more acceptable. Hence, dancing robots have generated a considerable research interest in the recent years. In this paper, we present a novel formalization of robot dancing as planning and control of optimally timed actions based on
beat timings and additional features extracted from the music.
We showcase the use of this formulation in three different variations: with input of a human expert choreography, imitation of a predefined choreography, and automated generation of a novel choreography. Our method has been validated on four different musical pieces, both in simulation and on a real robot, using the upper-body humanoid robot RH5 Manus.
More information:
Preprint DOI: 10.13140/RG.2.2.29096.03845
GitHub:
https://github.com/dfki-ric-underactuated-lab/robot_dance_generation
System:
RH5 Manus: https://robotik.dfki-bremen.de/de/forschung/robotersysteme/rh5-manus/
Projects:
Humane-AI NET: https://www.humane-ai.eu/
KiMMI-SF: https://robotik.dfki-bremen.de/de/forschung/projekte/kimmi-sf/fileadmin/templates/
M-RoCK: https://robotik.dfki-bremen.de/de/forschung/projekte/m-rock/typo3temp/_processed_/
VeryHuman: https://robotik.dfki-bremen.de/de/forschung/projekte/veryhuman/en/sitemap/
Underactuated Lab: https://robotik.dfki-bremen.de/de/forschung/testanlagen-labore/underactuated-lab/
Music licence:
"MACARENA (INTERNATIONAL VERSION)”, Artist: Los Fleming, © Ediciones Musicales Warner Bros
publisher:
Neue Welt Musikverlag GmbH
label:
WARNER CHAPPELL MUSIC SPAIN, S.A.U.
Видео Robot Dance Generation based on Music Analysis Driven Trajectory Optimization канала German Research Center for Artificial Intelligence
Musical dancing is an ubiquitous phenomenon in human society. Providing robots the ability to dance has the potential to make the human robot co-existence more acceptable. Hence, dancing robots have generated a considerable research interest in the recent years. In this paper, we present a novel formalization of robot dancing as planning and control of optimally timed actions based on
beat timings and additional features extracted from the music.
We showcase the use of this formulation in three different variations: with input of a human expert choreography, imitation of a predefined choreography, and automated generation of a novel choreography. Our method has been validated on four different musical pieces, both in simulation and on a real robot, using the upper-body humanoid robot RH5 Manus.
More information:
Preprint DOI: 10.13140/RG.2.2.29096.03845
GitHub:
https://github.com/dfki-ric-underactuated-lab/robot_dance_generation
System:
RH5 Manus: https://robotik.dfki-bremen.de/de/forschung/robotersysteme/rh5-manus/
Projects:
Humane-AI NET: https://www.humane-ai.eu/
KiMMI-SF: https://robotik.dfki-bremen.de/de/forschung/projekte/kimmi-sf/fileadmin/templates/
M-RoCK: https://robotik.dfki-bremen.de/de/forschung/projekte/m-rock/typo3temp/_processed_/
VeryHuman: https://robotik.dfki-bremen.de/de/forschung/projekte/veryhuman/en/sitemap/
Underactuated Lab: https://robotik.dfki-bremen.de/de/forschung/testanlagen-labore/underactuated-lab/
Music licence:
"MACARENA (INTERNATIONAL VERSION)”, Artist: Los Fleming, © Ediciones Musicales Warner Bros
publisher:
Neue Welt Musikverlag GmbH
label:
WARNER CHAPPELL MUSIC SPAIN, S.A.U.
Видео Robot Dance Generation based on Music Analysis Driven Trajectory Optimization канала German Research Center for Artificial Intelligence
Показать
Комментарии отсутствуют
Информация о видео
18 сентября 2023 г. 18:19:22
00:03:16
Другие видео канала
BaSynaos - Online-Prozessplanung für Intralogistik und Produktion im Basissystem für Industrie 4.0Kollaborierende Roboter und klassische Industrierobotik? | Dr. Tim Schwartz | DFKIWhy do we need an explainable AI?DFKI auf der HANNOVER MESSE 2023RealAIGym: Education and Research Platform for Studying Athletic IntelligenceFASTER: Explore space faster and safer (short version)CoMem – AI to assist daily work in companiesCoMem – KI zur Assistenz der täglichen Arbeit im UnternehmenTransTerrA: Coyote III crater trialsANT - navigation system enables walking systems to explore rough inclined terrainBIONIC – Intelligent sensor networks reduce physical stress30 Jahre DFKI – Open House – Trailer KurzfassungWas ist Deep Learning?DFKI auf der CeBIT 2016ANT – Novel Navigation System for Multi-legged Robots, second phaseProject WALL-ET – Assistance in supermarkets and warehouses through social, cognitive robotsWie denkt ein Informatiker? – DFKI beim Digitaltag 20213D Dual-Reality Benutzerschnittstelle / Guided ABIntelligent space robotics: scientist Wiebke Brinkmann speaks on the EU-funded research in BremenSELFIE: Self-Verification of Electronic Systems30 Jahre DFKI – Open House – Trailer Langfassung