PR-231: A Simple Framework for Contrastive Learning of Visual Representations
TensorFlow Korea 논문읽기모임 PR12 231번째 논문 review 입니다
이번 논문은 Google Brain에서 나온 A Simple Framework for Contrastive Learning of Visual Representations입니다. Geoffrey Hinton님이 마지막 저자이시기도 해서 최근에 더 주목을 받고 있는 논문입니다.
이 논문은 최근에 굉장히 핫한 topic인 contrastive learning을 이용한 self-supervised learning쪽 논문으로 supervised learning으로 학습한 ResNet50와 동일한 성능을 얻을 수 있는 unsupervised pre-trainig 방법을 제안하였습니다. Data augmentation, Non-linear projection head, large batch size, longer training, NTXent loss 등을 활용하여 훌륭한 representation learning이 가능함을 보여주었고, semi-supervised learning이나 transfer learning에서도 매우 뛰어난 결과를 보여주었습니다. 자세한 내용은 영상을 참고해주세요
논문링크: https://arxiv.org/abs/2002.05709
발표자료링크: https://www.slideshare.net/JinwonLee9/pr231-a-simple-framework-for-contrastive-learning-of-visual-representations
Видео PR-231: A Simple Framework for Contrastive Learning of Visual Representations канала JinWon Lee
이번 논문은 Google Brain에서 나온 A Simple Framework for Contrastive Learning of Visual Representations입니다. Geoffrey Hinton님이 마지막 저자이시기도 해서 최근에 더 주목을 받고 있는 논문입니다.
이 논문은 최근에 굉장히 핫한 topic인 contrastive learning을 이용한 self-supervised learning쪽 논문으로 supervised learning으로 학습한 ResNet50와 동일한 성능을 얻을 수 있는 unsupervised pre-trainig 방법을 제안하였습니다. Data augmentation, Non-linear projection head, large batch size, longer training, NTXent loss 등을 활용하여 훌륭한 representation learning이 가능함을 보여주었고, semi-supervised learning이나 transfer learning에서도 매우 뛰어난 결과를 보여주었습니다. 자세한 내용은 영상을 참고해주세요
논문링크: https://arxiv.org/abs/2002.05709
발표자료링크: https://www.slideshare.net/JinwonLee9/pr231-a-simple-framework-for-contrastive-learning-of-visual-representations
Видео PR-231: A Simple Framework for Contrastive Learning of Visual Representations канала JinWon Lee
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
PR-169: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
机器学习无监督界新宠 Contrastive Learning 对比学习简述 # 吐槽新加坡牙医
PR-208: Unsupervised Visual Representation Learning Overview:Toward Self-Supervision
Supervised Contrastive Learning
Contrastive Learning of visual representations - SimCLR (paper illustrated)
SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
CURL: Contrastive Unsupervised Representations for Reinforcement Learning
This Neural Network Learned To Look Around In Real Scenes! (NERF)
SimCLR Explained!
Lecture 7 Self-Supervised Learning -- UC Berkeley Spring 2020 - CS294-158 Deep Unsupervised Learning
Momentum Contrastive Learning
Vincent Spruyt: Loc2Vec: Self-supervised metric learning through triplet-loss![[2022 ICLR]Understanding Dimensional Collapse in Contrastive Self Supervised Learning Paper explain](https://i.ytimg.com/vi/dO-gD54OlO0/default.jpg)
[2022 ICLR]Understanding Dimensional Collapse in Contrastive Self Supervised Learning Paper explain
Ranking Loss, Contrastive Loss, Margin Loss, Triplet Loss and all those confusing names
C4W4L03 Siamese Network![[ECCV 2020] NeRF: Neural Radiance Fields (10 min talk)](https://i.ytimg.com/vi/LRAqeM8EjOo/default.jpg)
[ECCV 2020] NeRF: Neural Radiance Fields (10 min talk)
PR-149: Perceptual Losses for Real-Time Style Transfer and Super-Resolution
SimCLR Contrastive Image Learning
Yonglong Tian - Contrastive Learning: A General Self-supervised Learning Approach
Unsupervised Learning of Probably Symmetric Deformable 3D Objects From Images in the Wild