The Making of Sophia: Sophia's Singing Voice

Remember Sophia's duet with Jimmy Fallon? To create Sophia's singing voice Hanson Robotics joined up with CereProc, a text to speech (TTS) technology company that creates synthetic voices with character and personality.

The first step was for the woman who made the original recordings for Sophia’s voice to record a number of musical passages at a recording studio. CereProc then built a new database for singing synthesis and trained a Deep Neural Network (DNN) to reproduce the expression, contours, and timbre of the recorded passages.

The resulting model was then able to produce a sequence of musical notes combined with vocal phonemes, which form the sounds necessary to create human speech. To add an extra layer of richness, they used frequency and amplitude modulation to control the pitch and volume of Sophia’s voice, creating a natural-sounding vibrato that brings her performance to life.

To learn more about Sophia's singing, check out our blog post here: https://bit.ly/2Spr1OH

Subscribe to Hanson Robotics: https://bit.ly/2FWnF0M

Follow Sophia the Robot:
Twitter: https://twitter.com/realsophiarobot
Facebook: https://www.facebook.com/realsophiarobot/
Instagram: https://www.instagram.com/realsophiarobot
LinkedIn: https://www.linkedin.com/in/realsophiarobot/
YouTube: https://bit.ly/2RMawys

Follow Hanson Robotics:
Twitter: https://twitter.com/hansonrobotics
Facebook: https://www.facebook.com/hansonrobotics
Instagram: https://www.instagram.com/hansonrobotics
LinkedIn: https://www.linkedin.com/company/hanson-robotics/
YouTube: https://bit.ly/2FWnF0M

About Hanson Robotics:
Hanson Robotics is an AI and robotics company dedicated to creating empathetic, living, intelligent machines that enrich our lives. Our innovations in AI research and development, robotics engineering, experiential design, storytelling, and material science bring robots to life as engaging characters, useful products, and evolving AI to achieve the ever-greater good for all.

https://www.hansonrobotics.com

Видео The Making of Sophia: Sophia's Singing Voice канала Hanson Robotics Limited