How KV Cache Changes AI Performance: Solidigm Explains the Hidden Path of Every Prompt - Tech Talks

Learn More about Solidigm from AI Field Day: https://techfieldday.com/event/aifd8/
What really happens after you hit enter on an AI prompt? At AI Field Day 8, Stephen Foskett sits down with Solidigm’s Scott Shadley to break down the journey of AI data from user prompt to hardware infrastructure. Learn how tokens move through memory, storage, and KV cache, why GPUs spend so much time waiting, and how modern SSDs are helping reduce costs while improving AI performance. This discussion explores AI infrastructure, memory optimization, storage as a memory layer, GPU utilization, and the real-world impact of architectural decisions on large language models, AI agents, and enterprise AI deployments.

Solidigm Representative: Scott Shadley, Director, Leadership Narrative and Evangelist
LinkedIn: https://www.linkedin.com/in/scottshadley/

Learn more at www.Solidigm.com/

Host:
Stephen Foskett, President and Organizer of Tech Field Day
Tech Field Day: https://techfieldday.com/people/stephen-foskett/
LinkedIn: https://www.linkedin.com/in/sfoskett

Follow Tech Field Day:
Website: https://techfieldday.com/
LinkedIn: https://www.linkedin.com/company/tech-field-day/
X/Twitter: https://x.com/TechFieldDay
Bluesky: https://bsky.app/profile/techfieldday.com

Podcast:
Website: https://www.techfieldday.com/podcast
X/Twitter: https://www.twitter.com/techfielddaypod
Bluesky: https://bsky.app/profile/techfielddaypod.bsky.social

#TechTalks #AIFD8 #ArtificialIntelligence #AIInfrastructure #LLM #GenerativeAI #DataCenter #Storage #NVMe #MachineLearning

Видео How KV Cache Changes AI Performance: Solidigm Explains the Hidden Path of Every Prompt - Tech Talks канала Tech Field Day Plus