Salesforce Voice Agentforce - By Tim Dries - Biztory

🎙️ Salesforce Voice Assistant for AgentForce | Powered by OpenAI Whisper + TTS
By Tim Dries | Biztory

================================================
In this video we showcase the amazing work of Xavier Lengellé
MIT LICENSED
GITHUB source: agentforce-mcp-xlengelle
================================================

Transform how agents interact with Salesforce using natural voice commands. In this technical walkthrough, Tim Dries demos a powerful Lightning Web Component (LWC) that enables voice-driven interaction with your Salesforce data—fully integrated with AgentForce and powered by OpenAI’s Whisper (STT) and TTS (Text-to-Speech) APIs.

🔊 Key Features:
• 🎤 Speech-to-Text using OpenAI Whisper API
• 🧠 Smart intent processing via AgentForce (Salesforce AI Agent Platform)
• 🔈 Text-to-Speech responses with OpenAI’s lifelike voice models
• 🔁 Real-time voice loop: Speak → Understand → Respond

🛠️ Technical Overview:
• Built as a Lightning Web Component (LWC)
• Integrated with OpenAI APIs for speech recognition and synthesis
• Secure connection to AgentForce via Named Credentials
• Voice input/output with browser-native microphone/audio APIs
• Fully CSP-compliant (uses Blob URLs for audio playback)

📋 Prerequisites:
• Salesforce Org with API access
• AgentForce properly configured (Service Agent only)
• OpenAI API key with credit
• Salesforce CLI v2 installed
• OAuth credentials + Org metadata

🚀 Setup Highlights:
1. Configure CORS, Trusted URLs, Remote Sites
2. Create Named Credentials for OpenAI
3. Deploy via Salesforce CLI
4. Fill in API + AgentForce details in a custom settings page
5. Add the voice component to a Lightning App Page

🎥 Live Demo Includes:
• Voice-based data queries in Salesforce
• AgentForce response handling
• OpenAI TTS feedback playback
• Error handling + CSP workarounds

🧰 Built With:
• OpenAI Whisper + TTS
• Salesforce Apex + LWC
• AgentForce (Service Assistant)
• Blob URL audio handling for CSP compliance
• Custom Metadata for secure API key storage

🔐 Security First:
• No hardcoded secrets
• Secure API handling via Salesforce Named Credentials
• Browser permission management for microphone access

💬 Troubleshooting Tips covered in the video:
• Microphone issues
• Audio playback restrictions
• AgentForce response troubleshooting
• Deployment and permission errors

🔗 Follow along, clone the repo, and empower your agents with AI-driven voice interaction inside Salesforce!

#Salesforce #AgentForce #OpenAI #Whisper #TTS #VoiceAssistant #LWC #TimDries #Biztory #AIinCRM #LightningWebComponents #ServiceCloud #GenAI
==================================
MIT LICENSED GITHUB CONTENT
source: agentforce-mcp-xlengelle
==================================

Видео Salesforce Voice Agentforce - By Tim Dries - Biztory канала Tim Dries