Загрузка...

Deploying Frigate & Ollama on a Minisforum MS-A2 server

In this video I outfit a @minisforumofficial MS-A2 computer with a RTX A2000 12 GB GPU and set it up to be used as a server to host Frigate NVR, Ollama, and Open WebUI. I should the process for replacing the RTX A2000's cooler with a small one from N3rdware so that the GPU can fit within the MS-A2 server. I also show you how to use docker compose to easily set up Frigate, Ollama, and Open WebUI to run on the server.

The parts I used to build out this server (some links are affiliate):

Minisforum MS-A2: https://amzn.to/4fdurxS
Crucial 96GB DDR5 RAM: https://amzn.to/459APS9
Samsung 990 EVO Plus SSDs: https://amzn.to/4lVRy2D
Thermal Grizzly thermal paste: https://amzn.to/46y2Rt3
PNY RTX A2000 12GB GPU: https://amzn.to/4ml0tu9
N3rdware RTX A2000 Single Slot Cooler: https://n3rdware.com/components/single-slot-rtx-a2000-cooler

The Docker compose file template I created to deploy Frigate, Ollama, and Open WebUI: https://gist.github.com/michaelkamprath/8f44ab896c74a2d6579df9779e5d302e

The software used in this deployment:
- Frigate: https://frigate.video
- Ollama: https://ollama.com
- Open WebUI: https://openwebui.com

My wife's yoga-related channel: @YogawithGloria

*** Chapters ***
00:00 Intro
03:10 Parts overview
04:45 Replacing RTX A2000 cooler
08:47 Assembling the MS-A2 server
13:04 First boot!
14:18 Running MemTest
15:19 Boot into Ubuntu server
15:51 Configuring Frigate, Ollama, and Open WebUI
25:53 Deploying Frigate, Ollama, and Open WebUI
30:46 Reviewing Frigate's operations with Ollama
33:49 Using Ollama as a chatbot
37:07 Conclusion

Видео Deploying Frigate & Ollama on a Minisforum MS-A2 server канала Michael Kamprath
Яндекс.Метрика
Все заметки Новая заметка Страницу в заметки
Страницу в закладки Мои закладки
На информационно-развлекательном портале SALDA.WS применяются cookie-файлы. Нажимая кнопку Принять, вы подтверждаете свое согласие на их использование.
О CookiesНапомнить позжеПринять