Use Meta’s Llama 3 Model in Unity with Amazon Bedrock & other partner services

Hi XR Developers! In the last video we learnt how to record a voice command using Meta’s Voice SDK and turn our speech into text. In this video we can finally take this text and send it as a prompt to different Large Language Models or LLMs for short. We can then get a response back and use Meta’s Voice SDK to speak the response out loud. This allows you to for example create natural conversations with NPCs or Assistants in your Unity game. Today I show you how to use Amazon Bedrock to access Meta’s Llama Model, but this will work very similarly with any other partner provider!

👨‍💻Need help implementing this or any other features into your project? Let me help you out! https://calendly.com/xrdevrob/project-consulting

Resources:
🔗 Amazon Bedrock: https://aws.amazon.com/bedrock/
🔗 Amazon Bedrock Pricing: https://aws.amazon.com/bedrock/pricing/
🔗 NuGetForUnity: https://github.com/GlitchEnzo/NuGetForUnity/releases
🔗 Deploying Llama 3.1 405B Partner Guides: https://llama.meta.com/docs/getting-the-models/405b-partners/
🔗 Meta Llama in Amazon Bedrock: https://aws.amazon.com/bedrock/llama/

Other Videos:
📹 Mixed Reality Utility Kit: Build spatially-aware apps with Meta XR SDK: https://www.youtube.com/watch?v=n6YZlp4yMwM&t
📹 Meta’s Building Blocks | Develop Mixed Reality Apps lightning fast: https://www.youtube.com/watch?v=I8_BYPruDMk&t
📹 How to use Lights & Shadows in Passthrough Mode: https://www.youtube.com/watch?v=p8LYtvNxcf0&t
📹 Get Started with Meta Quest Development in Unity: https://www.youtube.com/watch?v=BU9LYKM2TDc&t
📹 Meta Quest Scene API: https://www.youtube.com/watch?v=b_1Xby35fSo&t
📹 Meta XR Simulator: https://www.youtube.com/watch?v=RRsxYtuO2iM&t

Join the Discord!
👾 https://discord.gg/v8fVjweUPB

Support the Channel:
🫂 Patreon: https://www.patreon.com/xrdevrob
🐦 Twitter: https://twitter.com/xrdevrob

🤝 Join this channel to get access to perks:
https://www.youtube.com/channel/UCat2tlm29PRViBe8_yz4j5Q/join

Need professional XR development for your project?
👨‍💻 Get in touch with us: https://bento.me/xrdevrob

00:00 Intro
01:03 Get Amazon Credentials and Access to Llama Model
02:20 Amazon Bedrock Pricing
02:30 Setup NuGetForUnity and Amazon Bedrock Namespaces
03:35 AmazonBedrockConnection.cs
07:40 Scene & TTS Setup
08:48 Testing
09:10 Connect Wake Word
09:45 Testing
10:05 Outro

Видео Use Meta’s Llama 3 Model in Unity with Amazon Bedrock & other partner services канала XR Dev Rob - XR AI Tutorials