PyTorch 2.0 is here! Quick tutorial + NVIDIA RTX 4080 giveaway

The official version PyTorch 2.0 just launched! In this video, I break down some of the updates and how you can use them in your PyTorch code.

Sign up for NVIDIA GTC March 2023 - https://nvda.ws/3GUZygQ
Details for giveaway - https://www.mrdbourke.com/pytorch-2

NVIDIA GTC sessions I'm going to:
Compile and train with 43% speedup using PyTorch 2.0 - https://dbourke.link/nvidia-gtc-2023-pytorch-2
Fireside Chat with Ilya Sutskever and Jensen Huang: AI Today and Vision of the Future - https://dbourke.link/nvidia-gtc-2023-fireside-chat
Exploring next-generation methods for optimizing PyTorch models for inference with Torch-TensorRT - https://dbourke.link/nvidia-gtc-2023-torch-tensorrt
FP8 Mixed-Precision Training with Hugging Face Accelerate - https://dbourke.link/nvidia-gtc-2023-fp8-training
Generative AI Demystified - https://dbourke.link/nvidia-gtc-2023-generative-ai-demystified

PyTorch 2.0 resources:
PyTorch 2.0 technical overview - https://pytorch.org/get-started/pytorch-2.0/
PyTorch 2.0 release notes - https://pytorch.org/blog/pytorch-2.0-release/
PyTorch 2.0 on TIMM/Hugging Face models - https://pytorch.org/blog/Accelerating-Hugging-Face-and-TIMM-models/
PyTorch 2.0 speedups on Diffusers - https://pytorch.org/blog/accelerated-diffusers-pt-20/
Which GPU for deep learning by Tim Dettmers - https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/
Make deep learning models go brrrr by Horace He - https://horace.io/brrr_intro.html
My PyTorch 2.0 code intro - https://github.com/mrdbourke/pytorch-deep-learning/blob/main/extras/pytorch_2_intro.ipynb
My PyTorch 2.0 benchmarks - https://github.com/mrdbourke/pytorch-deep-learning/tree/main/extras/pytorch_2_results

Other links:
Learn AI/ML (beginner-friendly courses I teach) - https://www.mrdbourke.com/ml-courses/
AI/ML courses/books I recommend - https://www.mrdbourke.com/ml-resources/
Read my novel Charlie Walks - https://www.charliewalks.com

Connect elsewhere:
Web - https://dbourke.link/web
Twitter - https://www.twitter.com/mrdbourke
Twitch - https://www.twitch.tv/mrdbourke
ArXiv channel (past streams) - https://dbourke.link/archive-channel
Get email updates on my work - https://dbourke.link/newsletter

Timestamps:
0:00 - Intro
0:10 - torch.compile()
0:53 - PyTorch 2.0 speedups
2:01 - PyTorch 2.0 new technologies
2:22 - Operator fusion
4:00 - Graph capture
5:14 - Other notable PyTorch 2.0 features
6:00 - GPU time
11:30 - NVIDIA GTC information and GPU giveaway details

#pytorch #ai

Видео PyTorch 2.0 is here! Quick tutorial + NVIDIA RTX 4080 giveaway канала Daniel Bourke