Season 2 Ep 22 Geoff Hinton on revolutionizing artificial intelligence... again
Over the past ten years, AI has experienced breakthrough after breakthrough in everything from computer vision to speech recognition, protein folding prediction, and so much more.
Many of these advancements hinge on the deep learning work conducted by our guest, Geoff Hinton, who has fundamentally changed the focus and direction of the field. A recipient of the Turing Award, the equivalent of the Nobel prize for computer science, he has over half a million citations of his work.
Hinton has spent about half a century on deep learning, most of the time researching in relative obscurity. But that all changed in 2012 when Hinton and his students showed deep learning is better at image recognition than any other approaches to computer vision, and by a very large margin. That result, that moment, known as the ImageNet moment, changed the whole AI field. Pretty much everyone dropped what they had been doing and switched to deep learning.
Geoff joins Pieter in our two-part season finale for a wide-ranging discussion inspired by insights gleaned from Hinton’s journey from academia to Google Brain. The episode covers how existing neural networks and backpropagation models operate differently than how the brain actually works; the purpose of sleep; and why it’s better to grow our computers than manufacture them.
What's in this episode:
00:00:00 - Introduction
00:02:48 - Understanding how the brain works
00:06:59 - Why we need unsupervised local objective functions
00:09:39 - Masked auto-encoders
00:10:55 - Current methods in end to end learning
00:18:36 - Spiking neural networks
00:23:00 - Leveraging spike times
00:29:55 - The story behind AlexNet
00:36:15 - Transition from pure academia to Google
00:40:23 - The secret auction of Hinton’s company at NuerIPS
00:44:18 - Hinton’s start in psychology and carpentry
00:54:34 - Why computers should be grown rather than manufactured
01:06:57 - The function of sleep and Boltzmann Machines
01:11:49 - Need for negative data
01:19:35 - Visualizing data using t-SNE
Links:
Geoff's Bio: https://en.wikipedia.org/wiki/Geoffrey_Hinton
Geoff's Twitter: https://twitter.com/geoffreyhinton?lang=en
Research and Publications: https://bit.ly/3z3M54e
Google Scholar Citations: https://bit.ly/3N892HJ
Story Behind the 2012 NIPS Auction: https://bit.ly/3t9xsIN
GLOM: https://bit.ly/3lYgWr6
Vector Institute: https://vectorinstitute.ai/
SUBSCRIBE TODAY:
Apple: https://apple.co/3NLtQED
Spotify: https://spoti.fi/3GBDpDM
Amazon: https://amzn.to/3NHlQoa
Google: https://bit.ly/3aD7ZkN
Acast: https://bit.ly/3x6ZYfw
Host: Pieter Abbeel
Executive Producers: Alice Patel & Henry Tobias Jones
Production: Fresh Air Production
Видео Season 2 Ep 22 Geoff Hinton on revolutionizing artificial intelligence... again канала The Robot Brains Podcast
Many of these advancements hinge on the deep learning work conducted by our guest, Geoff Hinton, who has fundamentally changed the focus and direction of the field. A recipient of the Turing Award, the equivalent of the Nobel prize for computer science, he has over half a million citations of his work.
Hinton has spent about half a century on deep learning, most of the time researching in relative obscurity. But that all changed in 2012 when Hinton and his students showed deep learning is better at image recognition than any other approaches to computer vision, and by a very large margin. That result, that moment, known as the ImageNet moment, changed the whole AI field. Pretty much everyone dropped what they had been doing and switched to deep learning.
Geoff joins Pieter in our two-part season finale for a wide-ranging discussion inspired by insights gleaned from Hinton’s journey from academia to Google Brain. The episode covers how existing neural networks and backpropagation models operate differently than how the brain actually works; the purpose of sleep; and why it’s better to grow our computers than manufacture them.
What's in this episode:
00:00:00 - Introduction
00:02:48 - Understanding how the brain works
00:06:59 - Why we need unsupervised local objective functions
00:09:39 - Masked auto-encoders
00:10:55 - Current methods in end to end learning
00:18:36 - Spiking neural networks
00:23:00 - Leveraging spike times
00:29:55 - The story behind AlexNet
00:36:15 - Transition from pure academia to Google
00:40:23 - The secret auction of Hinton’s company at NuerIPS
00:44:18 - Hinton’s start in psychology and carpentry
00:54:34 - Why computers should be grown rather than manufactured
01:06:57 - The function of sleep and Boltzmann Machines
01:11:49 - Need for negative data
01:19:35 - Visualizing data using t-SNE
Links:
Geoff's Bio: https://en.wikipedia.org/wiki/Geoffrey_Hinton
Geoff's Twitter: https://twitter.com/geoffreyhinton?lang=en
Research and Publications: https://bit.ly/3z3M54e
Google Scholar Citations: https://bit.ly/3N892HJ
Story Behind the 2012 NIPS Auction: https://bit.ly/3t9xsIN
GLOM: https://bit.ly/3lYgWr6
Vector Institute: https://vectorinstitute.ai/
SUBSCRIBE TODAY:
Apple: https://apple.co/3NLtQED
Spotify: https://spoti.fi/3GBDpDM
Amazon: https://amzn.to/3NHlQoa
Google: https://bit.ly/3aD7ZkN
Acast: https://bit.ly/3x6ZYfw
Host: Pieter Abbeel
Executive Producers: Alice Patel & Henry Tobias Jones
Production: Fresh Air Production
Видео Season 2 Ep 22 Geoff Hinton on revolutionizing artificial intelligence... again канала The Robot Brains Podcast
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![The ImageNet Moment with Geoff Hinton | Best Bits](https://i.ytimg.com/vi/gC_PoPye_CQ/default.jpg)
![Season 2 | On the DL with Sergey Levine](https://i.ytimg.com/vi/yivTPnFA4N0/default.jpg)
![Season 2 | On the DL with Amit Aggarwal of THE YES](https://i.ytimg.com/vi/qXanpHVIyLU/default.jpg)
![Season 2 | On the DL with Tanay Tandon of Athelas](https://i.ytimg.com/vi/GDhTyjapxJk/default.jpg)
![Season 2 Ep. 3 David Rolnick on why machine learning is a helpful tool for tackling climate change](https://i.ytimg.com/vi/84IIXsOl6No/default.jpg)
![Season 2 | On the DL with Adam Bry of Skydio](https://i.ytimg.com/vi/BhbjdNPp6_Y/default.jpg)
![Season 2 | On the DL with Param Hedge](https://i.ytimg.com/vi/A0EeX2htJkw/default.jpg)
![Season 2 | On the DL with Alex Kendall](https://i.ytimg.com/vi/36qNyLocakY/default.jpg)
![Season 2 | On the DL with Mike Fisher of Etsy](https://i.ytimg.com/vi/85m5s0xHOLE/default.jpg)
![Season 2 Ep. 11 Revolution Robotics is bringing a robotics team to every school](https://i.ytimg.com/vi/cYEtqZ5iDKk/default.jpg)
![Season 2 | On the DL with Amit Prakash of ThoughtSpot](https://i.ytimg.com/vi/yzpGsisXgAE/default.jpg)
![S3 Ep 11 Kiva & Verity Founder, Artist, ETH Prof Raff D'Andrea: Making drones useful](https://i.ytimg.com/vi/DgwhJnkmxZw/default.jpg)
![What's next in human-robot relations? | The Robot Brains Podcast](https://i.ytimg.com/vi/bcwk2p06B7g/default.jpg)
![Season 2 | On the DL with Gustav Söderström of Spotify](https://i.ytimg.com/vi/rUgkpt5ZOqs/default.jpg)
![Mike Volpi explains why "momentum" is the key for successful startups | The Robot Brains Podcast](https://i.ytimg.com/vi/sIIiIN6Vajg/default.jpg)
![Why "waste picking" centers are an engineering nightmare | Best Bits](https://i.ytimg.com/vi/dxL-VxWTkuw/default.jpg)
![Season 2 | On the DL with Clement Delangue of Hugging Face](https://i.ytimg.com/vi/pck3whFRFWc/default.jpg)
![Season 1 Ep.6 Keenan Wyrobek discusses how Zipline's AI-drones are reshaping Africa](https://i.ytimg.com/vi/a0ghXFhG3_E/default.jpg)
![Silicon Valley VC Mike Volpi Gives Advice to Startup Entrepreneurs](https://i.ytimg.com/vi/DFI8DcKDxDI/default.jpg)
![Season 1 Ep.18 Chris Urmson, Aurora | The Robot Brains Podcast](https://i.ytimg.com/vi/DvNrruSPCmY/default.jpg)
![Preview of Episode 12, Season 2 with Ohio State College of Engineering Dean Ayanna Howard](https://i.ytimg.com/vi/4QmKbFdmcfY/default.jpg)