Trends in AI Infrastructure - Andrey Cheptsov

In this podcast episode, we talked with Andrey Cheptsov about The future of AI infrastructure .

In this episode, we dive into the complexities of AI infrastructure with Andrey Cheptsov, founder and CEO of dstack. We explore topics like the challenges of using Kubernetes for AI workloads, the need to rethink container orchestration, and the future of hybrid and cloud-only infrastructures. Andrey also shares insights into the role of on-premise and bare-metal solutions, edge computing, and federated learning.

0:00 Andrey's Career Journey: From JetBrains to DStack
5:00 The Motivation Behind DStack
7:00 Challenges in Machine Learning Infrastructure
10:00 Transitioning from Cloud to On-Prem Solutions
14:30 Reflections on OpenAI's Evolution
17:30 Open Source vs Proprietary Models: A Balanced Perspective
21:01 Monolithic vs. Decentralized AI businesses
22:05 The role of privacy and control in AI for industries like banking and healthcare
30:00 Challenges in training large AI models: GPUs and distributed systems
37:03 DeepSpeed's efficient training approach vs. brute force methods
39:00 Challenges for small and medium businesses: hosting and fine-tuning models
47:01 Managing Kubernetes challenges for AI teams
52:00 Hybrid vs. cloud-only infrastructure
56:03 On-premise vs. bare-metal solutions
58:05 Exploring edge computing and its challenges

🔗 CONNECT WITH ANDREY CHEPTSOV
Twitter - https://twitter.com/andrey_cheptsov/
Linkedin - https://www.linkedin.com/in/andrey-cheptsov/
GitHub - https://github.com/dstackai/dstack/
Website - https://dstack.ai/

🔗 CONNECT WITH DataTalksClub
Join the community - https://datatalks.club/slack.html
Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ
Check other upcoming events - https://lu.ma/dtc-events
LinkedIn - https://www.linkedin.com/company/datatalks-club/
Twitter - https://twitter.com/DataTalksClub
Website - https://datatalks.club/

🔗 CONNECT WITH ALEXEY
Twitter - https://twitter.com/Al_Grigor
Linkedin - https://www.linkedin.com/in/agrigorev/

📚Check our free online courses
ML Engineering course - http://mlzoomcamp.com
Data Engineering course - https://github.com/DataTalksClub/data-engineering-zoomcamp uj7jh1c6xg
MLOps course - https://github.com/DataTalksClub/mlops-zoomcamp
Analytics in Stock Markets - https://github.com/DataTalksClub/stock-markets-analytics-zoomcamp
LLM course - https://github.com/DataTalksClub/llm-zoomcamp
Read about all our courses in one place - https://datatalks.club/blog/guide-to-free-online-courses-at-datatalks-club.html

👋🏼 GET IN TOUCH
If you want to support our community, use this link - https://github.com/sponsors/alexeygrigorev

If you’re a company, reach us at alexey@datatalks.club

Видео Trends in AI Infrastructure - Andrey Cheptsov канала DataTalksClub ⬛