Local Ai Server Setup Guides Proxmox 9 - OpenWEBUI Ollama in LXC w/ GPU Passthrough

In this first guide we complete the steps to setup a basic local ai server based off Proxmox 9 for Nvidia GPUs with Ollama and OpenWEBUI. This is part one in a multipart series. If you want to be able to rapidly deploy new projects

**IF YOU HAVE BLACKWELL 50x0 series Nvidia GPU's select the MIT and not Proprietary version during install.**

These guides are meant to be followed in this order:
▶️ 📍YOU ARE HERE📍 Ollama Openwebui Video
📝 Ollama Openwebui Article https://digitalspaceport.com/how-to-setup-an-ai-server-homelab-beginners-guides-ollama-and-openwebui-on-proxmox-lxc/
▶️ Llamacpp Unsloth Video https://youtu.be/CBNbM-RZgIQ
📝 Llamacpp Unsloth Article https://digitalspaceport.com/how-to-setup-an-ai-server-homelab-beginners-guides-llama-cpp-on-proxmox-9-lxc/
(Optional Guides)
▶️ vLLM Video https://youtu.be/CBNbM-RZgIQ
📝 vLLM Article https://digitalspaceport.com/how-to-setup-vllm-local-ai-homelab-ai-server-beginners-guides/
▶️ VibeVoice 7b TTS Video https://youtu.be/t7WH-86Jtn0
📝 VibeVoice Article https://digitalspaceport.com/how-to-setup-vibevoice-ai-podcast-tts-podcast-engine/

Quad 3090 Ryzen AI Rig Build 2025 Video w/cheaper components vs EPYC Build https://youtu.be/So7tqRSZ0s8
Written Build Guide with all the Updated AI Rig Component Options and Benchmarks https://digitalspaceport.com/local-ai-home-server-build-at-high-end-3500-5000-price/

QUAD 3090 AI HOME SERVER BUILD
GPU Rack Frame https://geni.us/GPU_Rack_Frame
Supermicro H12ssl-i MOBO (better option vs mz32-ar0) https://geni.us/MBD_H12SSL-I-O
Gigabyte MZ32-AR0 MOBO https://geni.us/mz32-ar0_motherboard
AMD 7V13 (newer, faster vs 7702) https://geni.us/EPYC_7V13_CPU
RTX 3090 24GB GPU (x4) https://geni.us/GPU3090
256GB (8x32GB) DDR4 2400 RAM https://geni.us/256GB_DDR4_RAM
PCIe4 Risers (x4) https://geni.us/PCIe4_Riser_Cable
AMD SP3 Air Cooler (easier vs water cooler) https://geni.us/EPYC_SP3_COOLER
iCUE H170i water cooler https://geni.us/iCUE_H170i_Capellix
(sTRX4 fits SP3 and retention kit comes with the CAPELLIX)
CORSAIR HX1500i PSU https://geni.us/Corsair_HX1500iPSU
4i SFF-8654 to 4i SFF-8654 (x4, not needed for H12SSL-i) https://geni.us/SFF8654_to_SFF8654
ARCTIC MX4 Thermal Paste https://geni.us/Arctic_ThermalPaste
Kritical Thermal GPU Pads https://geni.us/Kritical-Thermal-Pads
HDD Rack Screws for Fans https://geni.us/HDD_RackScrews

▶️ Local Ai Server Builds:
Quad 3090 Ai Server Build https://youtu.be/JN4EhaM7vyw
Playlist https://www.youtube.com/playlist?list=PLarJAzZsWRGDktdCjcN51G4xVkvvjC0ZB

Ways to Support:
🚀 Join as a member for members-only content and extra perks https://www.youtube.com/c/digitalspaceport/join
☕ Buy Me a Coffee https://www.buymeacoffee.com/digitalspaceport
🔳 Patreon https://www.patreon.com/digitalspaceport
👍 Subscribe youtube.com/c/digitalspaceport?sub_confirmation=1
🌐 Check out the Website https://digitalspaceport.com

Chapters
0:00 Ultimate Proxmox LXC Local Ai Setup Guide
0:45 Burn Proxmox ISO to USB
1:55 Proxmox 9 BIOS Settings AMD cpu
4:00 Install Proxmox 9 ZFS on Root
7:11 Proxmox 9 Overview
8:40 Proxmox Helper Scripts Post Install
13:19 Install OpenWEBUI on Proxmox
18:32 Setup Nvidia GPU Passthru LXC Proxmox
28:25 Add Models to OpenWEBUI
31:26 GPT-OSS 20B Performance 3090
32:56 Growing ZFS Storage

*****
As an Amazon Associate I earn from qualifying purchases.
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****

Видео Local Ai Server Setup Guides Proxmox 9 - OpenWEBUI Ollama in LXC w/ GPU Passthrough канала Digital Spaceport