Open Assistant Inference Backend Development (Hands-On Coding)
#ai #huggingface #coding
Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...
Original repo is here: https://github.com/huggingface/text-generation-inference
OpenAssistant repo is here: https://github.com/LAION-AI/Open-Assistant (see inference/)
Check out https://www.wandb.courses/ for free MLOps courses!
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
Видео Open Assistant Inference Backend Development (Hands-On Coding) канала Yannic Kilcher
Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...
Original repo is here: https://github.com/huggingface/text-generation-inference
OpenAssistant repo is here: https://github.com/LAION-AI/Open-Assistant (see inference/)
Check out https://www.wandb.courses/ for free MLOps courses!
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
Видео Open Assistant Inference Backend Development (Hands-On Coding) канала Yannic Kilcher
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
WHO ARE YOU? 10k Subscribers Special (w/ Channel Analytics)
Datasets for Data-Driven Reinforcement Learning
Reinforcement Learning with Augmented Data (Paper Explained)
The Odds are Odd: A Statistical Test for Detecting Adversarial Examples
AMP: Adversarial Motion Priors for Stylized Physics-Based Character Control (Paper Explained)
Expire-Span: Not All Memories are Created Equal: Learning to Forget by Expiring (Paper Explained)
REALM: Retrieval-Augmented Language Model Pre-Training (Paper Explained)
Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation (Paper Explained)![[Classic] Playing Atari with Deep Reinforcement Learning (Paper Explained)](https://i.ytimg.com/vi/rFwQDDbYTm4/default.jpg)
[Classic] Playing Atari with Deep Reinforcement Learning (Paper Explained)
Symbolic Knowledge Distillation: from General Language Models to Commonsense Models (Explained)
Gradient Origin Networks (Paper Explained w/ Live Coding)
Perceiver: General Perception with Iterative Attention (Google DeepMind Research Paper Explained)
PonderNet: Learning to Ponder (Machine Learning Research Paper Explained)
GLOM: How to represent part-whole hierarchies in a neural network (Geoff Hinton's Paper Explained)
ALiBi - Train Short, Test Long: Attention with linear biases enables input length extrapolation
Listening to You! - Channel Update (Author Interviews)![[ML News] Uber: Deep Learning for ETA | MuZero Video Compression | Block-NeRF | EfficientNet-X](https://i.ytimg.com/vi/fEKZC9mta8w/default.jpg)
[ML News] Uber: Deep Learning for ETA | MuZero Video Compression | Block-NeRF | EfficientNet-X
On the Measure of Intelligence by François Chollet - Part 1: Foundations (Paper Explained)
Growing Neural Cellular Automata![[ML News] DeepMind's Flamingo Image-Text model | Locked-Image Tuning | Jurassic X & MRKL](https://i.ytimg.com/vi/smUHQndcmOY/default.jpg)
[ML News] DeepMind's Flamingo Image-Text model | Locked-Image Tuning | Jurassic X & MRKL
Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments (Review)