I Built My Own Animated Digital Assistant Like Jarvis

In this video, I show how we combined Unity, Python, Piper TTS, speech recognition, and microphone input to create SHANE, our own animated digital assistant inspired by JARVIS from the Iron Man movies and comics.

SHANE can listen for spoken commands, convert speech into text, send the recognized message from Unity to a Python server, process the response, and speak back using the free, locally hosted Piper text-to-speech engine. We also added visual feedback in Unity, allowing the assistant’s gold logo to pulse and glow whenever SHANE responds.

This project brings several systems together:

• Real-time microphone recording and speech recognition in Unity
• Communication between Unity and a Python Flask server
• Local text-to-speech generation with Piper TTS
• Audio playback without relying on a paid cloud service
• An animated digital-assistant interface with a glowing logo
• Logic that only activates the animation when Python returns a real response

The goal was to create a private, customizable AI-style assistant that can eventually control applications, retrieve information, automate tasks, and interact with a 3D Unity environment.

This is not the fictional JARVIS system, but it demonstrates how tools available today can be connected to build a functional voice-controlled digital assistant on your own computer.

Here is a link to my GiHub with all the relevant, final codes in the video. https://github.com/bjone6/Interactive_Animated_DigitalAssistant

✅ Subscribe To The Channel For More Videos:
https://www.youtube.com/@BrandonJacobson/?sub_confirmation=1

✅ Stay Connected With Me:

👉 (X)Twitter: https://x.com/BrandonJInc

==============================

✅ Other Videos You Might Be Interested In Watching:

👉 https://www.youtube.com/watch?v=5OOBZgc9a48
👉 https://www.youtube.com/watch?v=D64UcX5Bz-0
👉 https://www.youtube.com/watch?v=g3eltHiEPAU
👉 https://www.youtube.com/watch?v=baXv5pZPlu0

=====================

🔎 Related Phrases:

#unity #python #PiperTTS #speechrecognition #texttospeech #digitalassistant #voiceassistant #artificialintelligence #unitydevelopment #pythonprogramming #JarvisInspired

Видео I Built My Own Animated Digital Assistant Like Jarvis канала Brandon Jacobson (Jacobson Enterprises)