Загрузка...

Coding Stable Diffusion from scratch in PyTorch

Full coding of Stable Diffusion from scratch, with full explanation, including explanation of the mathematics. Visual explanation of text-to-image, image-to-image, inpainting

Repository with PDF slides: https://github.com/hkproj/pytorch-stable-diffusion

Prerequisites:
1) Transformer explained: https://www.youtube.com/watch?v=bCz4OMemCcA

Chapters
00:00:00 - Introduction
00:04:30 - What is Stable Diffusion?
00:05:40 - Generative Models
00:12:07 - Forward and Reverse Process
00:17:44 - ELBO and Loss
00:20:30 - Generating New Data
00:22:20 - Classifier-Free Guidance
00:31:00 - CLIP
00:33:20 - Variational Auto Encoder
00:37:26 - Text to Image
00:39:54 - Image to Image
00:41:40 - Inpainting
00:44:30 - Coding the VAE
01:54:50 - Coding CLIP
02:09:10 - Coding the Unet
03:04:40 - Coding the Pipeline
03:53:00 - Coding the Scheduler (DDPM)
04:38:00 - Coding the Inference code

Видео Coding Stable Diffusion from scratch in PyTorch канала Umar Jamil
deep learning pytorch ai ml machine learning paper review coding coding from scratch stable diffusion diffusion models inpainting latent diffusion models ddpm denoising diffusion probabilistic models python visual explanation
Комментарии отсутствуют
Зарегистрируйтесь или войдите с
Информация о видео
27 сентября 2023 г. 6:51:59
05:03:32
Umar Jamil
Теги
Правообладателям
Жалоба на материал Недопустимый материал Нарушение авторских прав
Комментарии
Поделиться
Другие видео канала

LongNet: Scaling Transformers to 1,000,000,000 tokens: Python Code + ExplanationLongNet: Scaling Transformers to 1,000,000,000 tokens: Python Code + Explanation

Coding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNormCoding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNorm

ML Interpretability: feature visualization, adversarial example, interp. for language modelsML Interpretability: feature visualization, adversarial example, interp. for language models

Flash Attention derived and coded from first principles with Triton (Python)Flash Attention derived and coded from first principles with Triton (Python)

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, mathDirect Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanationCoding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and codeDistributed Training with PyTorch: complete tutorial with cloud infrastructure and code

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratchLoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

How diffusion models work - explanation and code!How diffusion models work - explanation and code!

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware TrainingQuantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Titans: Learning to Memorize at Test TimeTitans: Learning to Memorize at Test Time

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)

Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, MathMamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] tokenBERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLULLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Paper: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement LearningPaper: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling BufferMistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Kolmogorov-Arnold Networks: MLP vs KAN, Math, B-Splines, Universal Approximation TheoremKolmogorov-Arnold Networks: MLP vs KAN, Math, B-Splines, Universal Approximation Theorem

Яндекс.Метрика
© 2008-2026 «Информационно-развлекательный портал города Верхняя Салда»
salda.ws@mail.ru salda_ws Контакты Карта портала Сообщить об ошибке Соглашения Пользовательское соглашение Соглашение о конфиденциальности Согласие на обработку персональных данных Информация для правообладателей Об использовании Cookies
Все заметки Новая заметка Страницу в заметки
Страницу в закладки Мои закладки
На информационно-развлекательном портале SALDA.WS применяются cookie-файлы. Нажимая кнопку Принять, вы подтверждаете свое согласие на их использование.
О CookiesНапомнить позжеПринять