GPT-J-6B(GPT 3): How to Download And Use(Update in description)

GPT-J-6B is a new GPT model. At this time, it is the largest GPT model released publicly. Eventually, it will be added to Huggingface, however, as of now, it has not been added. In this video, I go over how to download and use this massive model before it's added to Huggingface.

Update video on HuggingFace update: https://www.youtube.com/watch?v=bLMbnHunL_E&ab_channel=Blake
This update makes it much easier to use and fine-tune the model.

Github: https://github.com/mallorbc/gpt-j-6b

Timeline

00:00 Intro
00:31 GPT-J Pull Request
01:15 Background Of Large NLP Models
02:31 Setting Up Envrionment
04:00 Starting The Jupyter Notebook
04:18 Installing Dependencies
05:08 Downloading The Model Weights
05:55 Converting The Weights To Pytorch Weights
07:15 Loading The Converted Model
09:13 Using GPT-J-6B To Generate Outputs
10:15 Outro And Future Work

Видео GPT-J-6B(GPT 3): How to Download And Use(Update in description) канала Blake