GPU Passthrough on Linux and Docker for AI, ML, and Plex

We've already figured out how to pass through a GPU to Windows machine but why let Windows have all the fun? Today, we do it on an Ubuntu headless server that's virtualized, run some AI and Deep Learning workloads, then turn up the transcoding on Plex to 11.

Video Notes: https://technotim.live/posts/gpu-passthrough-linux/

📦 Cards I mention that don't require external power
GTX 1650 https://amzn.to/3dnG31y
GTX 1050 https://amzn.to/2GQlOgO
(Affiliate links may be included in this description. I may receive a small commission at no cost to you.)

Video mentioned:
• Remote Gaming! (and Video Encoding using Proxmox and GPU Passthrough)
https://www.youtube.com/watch?v=fgx3NMk6F54
• 4 Ways to Install Plex (one is unexpected)
https://www.youtube.com/watch?v=MG_1XQxWns0

Support me on Patreon: https://www.patreon.com/technotim
Sponsor me on GitHub: https://github.com/sponsors/timothystewart6
Subscribe on Twitch: https://www.twitch.tv/technotim
Become a YouTube member: https://www.youtube.com/channel/UCOk-gHyjcWZNj3Br4oxwh0A/join
Merch Shop: https://l.technotim.live/shop
Gear Recommendations: https://l.technotim.live/gear
Get Help in Our Discord Community: https://l.technotim.live/discord
2nd channel: https://www.youtube.com/@TechnoTimTalks

(Affiliate links may be included in this description. I may receive a small commission at no cost to you.)

00:00 - Intro
00:47 - Why use a GPU with Docker & Kubernetes?
01:43 - What are we going to do today?
02:17 - Passing through an NVIDIA card with Proxmox
02:55 - Add video card and modify config
03:36 - Install NVIDIA drivers on an Ubuntu headless server
04:25 - Install Docker support for NVIDIA
05:19 - Check NVIDIA driver to make sure it is exposed to Docker
06:09 - Install nvtop to measure and monitor our GPU
06:27 - Launch Deep learning TensorFlow workload
07:30 - Set up Plex using Kubernetes, Docker, Rancher
07:43 - NVIDIA with Rancher and Kubernetes
08:51 - Plex Hardware Accelerated Transcoding in Docker
09:13 - Transcode 4k video with NVENC in Docker
11:00 - Would you ever use this?
11:31 - Stream Highlight -The most unexpected follow yet!

#Homelab #Docker #GPUPassthrough #Kubernetes #Rancher #TechnoTim #Proxmox #Virtualization
#Plex

"Big Buck Bunny" which appears in this video is licensed under the Creative Commons Attribution 3.0
https://peach.blender.org/about/

Thank you for watching!

Видео GPU Passthrough on Linux and Docker for AI, ML, and Plex канала Techno Tim