[RANT] Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers?
“Pen and paper fool OpenAI!” Typographic attacks in the wild. Or not.
Ms. Coffee Bean rants about the typographic attacks on OpenAI’s CLIP. Are we really fooling the model or are we fooling ourselves? A different take on the adversarial attacks on OpenAI’s CLIP model.
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 CLIP explained: https://youtu.be/dh8Rxhf7cLU
📄 Multimodal Neurons in Artificial Neural Networks: https://openai.com/blog/multimodal-neurons/
Outline:
* 00:00 Fooling CLIP
* 00:51 What is this all about?
* 03:22 Why zero-shot failure is not an attack
* 05:48 Reasons to worry
🤩 CLIP code: https://github.com/openai/CLIP
🤩 Cool list of OpenAI’s CLIP applications list on Reddit: https://www.reddit.com/r/MachineLearning/comments/ldc6oc/p_list_of_sitesprogramsprojects_that_use_openais/
📺 @Yannic Kilcher explaines Multimodal Neurons in Artificial Neural Networks: https://youtu.be/Z_kWZpgEZ7w
📺 @Yannic Kilcher fix for CLIP adversarial attack: https://youtu.be/Rk3MBx20z24
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #rant #MachineLearning #AI #OpenAI
Video contains emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Music:
🎵 Brainmelt by Underbelly
🎵 Discovery Hit by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 licence. https://creativecommons.org/licenses/by/4.0/
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1300023
Artist: http://incompetech.com/
Видео [RANT] Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers? канала AI Coffee Break with Letitia
Ms. Coffee Bean rants about the typographic attacks on OpenAI’s CLIP. Are we really fooling the model or are we fooling ourselves? A different take on the adversarial attacks on OpenAI’s CLIP model.
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 CLIP explained: https://youtu.be/dh8Rxhf7cLU
📄 Multimodal Neurons in Artificial Neural Networks: https://openai.com/blog/multimodal-neurons/
Outline:
* 00:00 Fooling CLIP
* 00:51 What is this all about?
* 03:22 Why zero-shot failure is not an attack
* 05:48 Reasons to worry
🤩 CLIP code: https://github.com/openai/CLIP
🤩 Cool list of OpenAI’s CLIP applications list on Reddit: https://www.reddit.com/r/MachineLearning/comments/ldc6oc/p_list_of_sitesprogramsprojects_that_use_openais/
📺 @Yannic Kilcher explaines Multimodal Neurons in Artificial Neural Networks: https://youtu.be/Z_kWZpgEZ7w
📺 @Yannic Kilcher fix for CLIP adversarial attack: https://youtu.be/Rk3MBx20z24
🔗 Links:
YouTube: https://www.youtube.com/AICoffeeBreak
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #rant #MachineLearning #AI #OpenAI
Video contains emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
Music:
🎵 Brainmelt by Underbelly
🎵 Discovery Hit by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 licence. https://creativecommons.org/licenses/by/4.0/
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1300023
Artist: http://incompetech.com/
Видео [RANT] Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers? канала AI Coffee Break with Letitia
Показать
Комментарии отсутствуют
Информация о видео
18 марта 2021 г. 18:00:26
00:11:10
Другие видео канала
![Leaking training data from GPT-2. How is this possible?](https://i.ytimg.com/vi/yhVlb-Hz6yM/default.jpg)
![15 Sorting Algorithms in 6 Minutes](https://i.ytimg.com/vi/kPRA0W1kECg/default.jpg)
![AI Coffee Break - Channel Trailer](https://i.ytimg.com/vi/h9xPrgTYP_0/default.jpg)
![Knife-wielding teen shot at school](https://i.ytimg.com/vi/VW9_MYYt-gQ/default.jpg)
![Pre-training of BERT-based Transformer architectures explained – language and vision!](https://i.ytimg.com/vi/dabFOBE4eZI/default.jpg)
![OpenAI DALL·E: Fighter Jet For The Mind! ✈️](https://i.ytimg.com/vi/C7D5EzkhT6A/default.jpg)
![](https://i.ytimg.com/vi/0E9e0fiyKKA/default.jpg)
![Diffusion models explained. How does OpenAI's GLIDE work?](https://i.ytimg.com/vi/344w5h24-h8/default.jpg)
![What It's Like To be a Computer: An Interview with GPT-3](https://i.ytimg.com/vi/PqbB07n_uQ4/default.jpg)
![14 Cool Apps Built on OpenAI's GPT-3 API](https://i.ytimg.com/vi/G6Z_S6hs29s/default.jpg)
![Eyes tell all: How to tell that an AI generated a face?](https://i.ytimg.com/vi/yCSXASFWNgA/default.jpg)
![OpenAI GPT-3 - Good At Almost Everything! 🤖](https://i.ytimg.com/vi/_x9AwxfjxvE/default.jpg)
![The ultimate intro to Graph Neural Networks. Maybe.](https://i.ytimg.com/vi/me3UsMm9QEs/default.jpg)
![This is NOT 3D SOFTWARE? | How I Create ''Microworlds''](https://i.ytimg.com/vi/Z6yXBh7WsKo/default.jpg)
![Transformer in Transformer: Paper explained and visualized | TNT](https://i.ytimg.com/vi/HWna2c5VXDg/default.jpg)
![Ian Goodfellow: Generative Adversarial Networks (GANs) | Lex Fridman Podcast #19](https://i.ytimg.com/vi/Z6rxFNMGdn0/default.jpg)
![OpenAI’s Sarcastic Chat Bot [GPT-3 API Beta]](https://i.ytimg.com/vi/Y4cj1jrOnuE/default.jpg)
![What is tokenization? How does it work? Tokenizers explained.](https://i.ytimg.com/vi/D8j1c4NJRfo/default.jpg)
![Swin Transformer paper animated and explained](https://i.ytimg.com/vi/SndHALawoag/default.jpg)
![ConvNeXt: A ConvNet for the 2020s – Paper Explained (with animations)](https://i.ytimg.com/vi/QqejV0LNDHA/default.jpg)