OpenAI’s CLIP explained! | Examples, links to code and pretrained model
Ms. Coffee Bean explains
❓ how OpenAI‘s CLIP works,
❔ what it can and cannot do
⁉️ and what people have been up to using CLIP in awesome applications!
📺 DALL-E explained by Ms. Coffee Bean: https://youtu.be/mvG2FGF0TvM
Outline:
* 00:00 CLIP and DALL-E
* 02:14 What can CLIP do?
* 04:22 How does CLIP work?
* 09:12 Limitations
* 12:39 Applications
📄 CLIP paper: Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. Learning Transferable Visual Models From Natural Language Supervision. Image, 2, T2. https://cdn.openai.com/papers/Learning_Transferable_Visual_Models_From_Natural_Language_Supervision.pdfd (last date accessed: 24.01.2021)
📚 CLIP blog: openai.com/blog/clip/
💻 CLIP Colab link: https://colab.research.google.com/github/openai/clip/blob/master/Interacting_with_CLIP.ipynb
Other links:
📄 Switch Transformers: Fedus, W., Zoph, B., & Shazeer, N. (2021). Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity. arXiv preprint arXiv:2101.03961.
https://arxiv.org/pdf/2101.03961.pdf
📚 Check out the section “10 Novel Applications using Transformers”: https://paperswithcode.com/newsletter/3
🐦Links to the application showcase in Twitter:
1. https://twitter.com/l4rz/status/1352630033832140800
2. https://twitter.com/haltakov/status/1351271379103002632
3. https://twitter.com/nagaraj_arvind/status/1350030541467258881
4. https://twitter.com/sayantandas_/status/1351830997403254785
------------------------------------------
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research
Thumbnail contains the tick emoji designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Видео OpenAI’s CLIP explained! | Examples, links to code and pretrained model канала AI Coffee Break with Letitia
❓ how OpenAI‘s CLIP works,
❔ what it can and cannot do
⁉️ and what people have been up to using CLIP in awesome applications!
📺 DALL-E explained by Ms. Coffee Bean: https://youtu.be/mvG2FGF0TvM
Outline:
* 00:00 CLIP and DALL-E
* 02:14 What can CLIP do?
* 04:22 How does CLIP work?
* 09:12 Limitations
* 12:39 Applications
📄 CLIP paper: Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. Learning Transferable Visual Models From Natural Language Supervision. Image, 2, T2. https://cdn.openai.com/papers/Learning_Transferable_Visual_Models_From_Natural_Language_Supervision.pdfd (last date accessed: 24.01.2021)
📚 CLIP blog: openai.com/blog/clip/
💻 CLIP Colab link: https://colab.research.google.com/github/openai/clip/blob/master/Interacting_with_CLIP.ipynb
Other links:
📄 Switch Transformers: Fedus, W., Zoph, B., & Shazeer, N. (2021). Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity. arXiv preprint arXiv:2101.03961.
https://arxiv.org/pdf/2101.03961.pdf
📚 Check out the section “10 Novel Applications using Transformers”: https://paperswithcode.com/newsletter/3
🐦Links to the application showcase in Twitter:
1. https://twitter.com/l4rz/status/1352630033832140800
2. https://twitter.com/haltakov/status/1351271379103002632
3. https://twitter.com/nagaraj_arvind/status/1350030541467258881
4. https://twitter.com/sayantandas_/status/1351830997403254785
------------------------------------------
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research
Thumbnail contains the tick emoji designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Видео OpenAI’s CLIP explained! | Examples, links to code and pretrained model канала AI Coffee Break with Letitia
Показать
Комментарии отсутствуют
Информация о видео
26 января 2021 г. 17:00:09
00:14:48
Другие видео канала
![Transformers can do both images and text. Here is why.](https://i.ytimg.com/vi/aH7s6qXEUcc/default.jpg)
![The curse of dimensionality. Or is it a blessing?](https://i.ytimg.com/vi/4v7ngaiFdp4/default.jpg)
![A GPT-3 for Images? Dall-E is the most impressive AI ever created!](https://i.ytimg.com/vi/xR6MxVoWg2E/default.jpg)
![OpenAI Plays Hide and Seek…and Breaks The Game! 🤖](https://i.ytimg.com/vi/Lu56xVlZ40M/default.jpg)
![[RANT] Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers?](https://i.ytimg.com/vi/xqdHfLrevuo/default.jpg)
![How cross-modal are vision and language models really? 👀 Seeing past words. [Own work]](https://i.ytimg.com/vi/ytxnTwHfWls/default.jpg)
![OpenAI CLIP: ConnectingText and Images (Paper Explained)](https://i.ytimg.com/vi/T9XSU0pKX2E/default.jpg)
![A Solid 15 Minutes Of Science Facts (w/ Mark Rober & More!)](https://i.ytimg.com/vi/JkIcZxal3Fg/default.jpg)
![OpenAI’s CLIP: Search Images with Descriptions Instead of Keywords](https://i.ytimg.com/vi/Ou6ghBUjt1c/default.jpg)
![GPT2 wrote this 1000 subscribers special!](https://i.ytimg.com/vi/TchiNj-BMtY/default.jpg)
![FNet: Mixing Tokens with Fourier Transforms – Paper Explained](https://i.ytimg.com/vi/j7pWPdGEfMA/default.jpg)
![Small language models are also few-shot learners! | PET, iPET, ADAPET explained!](https://i.ytimg.com/vi/P7Rav5tK3Y0/default.jpg)
![An image is worth 16x16 words: ViT | Is this the extinction of CNNs? Long live the Transformer?](https://i.ytimg.com/vi/DVoHvmww2lQ/default.jpg)
![Data-efficient Image Transformers EXPLAINED! Facebook AI's DeiT paper](https://i.ytimg.com/vi/-FbV2KgRM8A/default.jpg)
![CLIP: Connecting Text and Images](https://i.ytimg.com/vi/u0HG77RNhPE/default.jpg)
![OpenAI's DALL-E Can Create Images From Just Text Description](https://i.ytimg.com/vi/HAjBaWh_FgU/default.jpg)
![You Describe & AI Photoshops Faces For You [StyleCLIP]](https://i.ytimg.com/vi/d1OET63Ulwc/default.jpg)
![OpenAI GPT-3 - Good At Almost Everything! 🤖](https://i.ytimg.com/vi/_x9AwxfjxvE/default.jpg)
!["What Can We Do to Improve Peer Review in NLP?" 👀](https://i.ytimg.com/vi/ttDkpIq-sD4/default.jpg)
![NVIDIA Jarvis meets Ms. Coffee Bean](https://i.ytimg.com/vi/IOgxsULnqUo/default.jpg)