SimCLR Explained!
SimCLR is able to achieve the same (~76.5% top-1 ImageNet accuracy) as a ResNet-50 trained with Supervised Learning. SimCLR has also set a new high for Semi-Supervised Learning on 1% and 10% of the data, and it performs as well as Transfer Learning from models pre-trained on ImageNet classification! This paper explains the details of the algorithm such as the composition of data augmentations, separate projection from representation to contrastive loss, and the role of scaling up in unsupervised learning!
Links:
SimCLR: https://arxiv.org/pdf/2002.05709.pdf
CPC: https://arxiv.org/pdf/1905.09272.pdf
ImageBERT: https://arxiv.org/pdf/2001.07966.pdf
Google AI Blog: Revisiting the unreasonable effectiveness of data: https://ai.googleblog.com/2017/07/revisiting-unreasonable-effectiveness.html
Thanks for watching! Please Subscribe!
Видео SimCLR Explained! канала Henry AI Labs
Links:
SimCLR: https://arxiv.org/pdf/2002.05709.pdf
CPC: https://arxiv.org/pdf/1905.09272.pdf
ImageBERT: https://arxiv.org/pdf/2001.07966.pdf
Google AI Blog: Revisiting the unreasonable effectiveness of data: https://ai.googleblog.com/2017/07/revisiting-unreasonable-effectiveness.html
Thanks for watching! Please Subscribe!
Видео SimCLR Explained! канала Henry AI Labs
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Big Self-Supervised Models are Strong Semi-Supervised Learners (Paper Explained)Theory and Systems for Weak Supervision (WWW 2020 BIG)#032- Simon Kornblith / GoogleAI - SimCLR and Paper Haul!Phillip Isola -- When and Why Does Contrastive Learing Work?EfficientNet Explained!AlphaGo - How AI mastered the hardest boardgame in historyLong-Short TransformerCNN: Convolutional Neural Networks Explained - ComputerphileContrastive Learning for Unpaired Image-to-Image Translation30 Weird Chess Algorithms: Elo WorldWhat is Noise-Contrastive Estimation?Supervised Contrastive LearningFree Energy Principle — Karl FristonWill Self-Taught, A.I. Powered Robots Be the End of Us?MuZeroMomentum Contrastive LearningHow This Guy Uses A.I. to Create Art | Obsessed | WIREDA Friendly Introduction to Generative Adversarial Networks (GANs)Internet-Augmented Dialogue Generation