Загрузка...

Run ANY LLM Using Cloud GPU and TextGen WebUI (aka OobaBooga)

In this video, I'll show you how to use RunPod.io to quickly and inexpensively spin up top-of-the-line GPUs so you can run any large language model. It's super easy, and you can run even the largest models such as Guanaco 65b. This also includes a tutorial on Text Generation WebUI (aka OobaBooga), which is like Automatic1111 but for LLMs. Basically, an open-source interface for your LLM.

Enjoy :)

Join My Newsletter for Regular AI Updates 👇🏼
https://forwardfuture.ai/

My Links 🔗
👉🏻 Subscribe: https://www.youtube.com/@matthew_berman
👉🏻 Twitter: https://twitter.com/matthewberman
👉🏻 Discord: https://discord.gg/xxysSXBxFW
👉🏻 Patreon: https://patreon.com/MatthewBerman

Media/Sponsorship Inquiries 📈
https://bit.ly/44TC45V

Links:
Runpod (Affiliate)- https://bit.ly/3OtbnQx
Runpod The Bloke Template - https://runpod.io/gsc?template=qk29nkmbfr&ref=54s0k2f8
HuggingFace - https://www.huggingface.co
Guanaco Model - https://huggingface.co/TheBloke/guanaco-65B-GPTQ
TextGen WebUI - https://github.com/oobabooga/text-generation-webui

Видео Run ANY LLM Using Cloud GPU and TextGen WebUI (aka OobaBooga) канала Matthew Berman
Яндекс.Метрика
Все заметки Новая заметка Страницу в заметки
Страницу в закладки Мои закладки
На информационно-развлекательном портале SALDA.WS применяются cookie-файлы. Нажимая кнопку Принять, вы подтверждаете свое согласие на их использование.
О CookiesНапомнить позжеПринять