Setting up Mistral + TGI in Runpod

Step by step tutorial for setting up Text generation inference in Runpod environment.

Resources:
Text Generation Inference - https://github.com/huggingface/text-generation-inference
Runpod - https://www.runpod.io/
Notebook - https://github.com/srinathmkce/TheAIGuy/blob/main/NLP/llms/Runpod-TGI-Sanity-Test.ipynb

Timestamps:
0:00 Introduction
0:30 Create Storage
1:40 Create Secrets
2:33 Deploy
7:20 Sanity Test
10:01 Closing note

Видео Setting up Mistral + TGI in Runpod канала AI Paatshal