Exponential Progress of AI: Moore's Law, Bitter Lesson, and the Future of Computation
Discussion of exponential progress in AI and computation, including Moore's Law and the Bitter Lesson by Rich Sutton. This was part of the AI paper club on our Discord. Join here: https://discord.gg/8RwBPRs
Bitter Lesson: http://www.incompleteideas.net/IncIdeas/BitterLesson.html
Slides for this video: https://bit.ly/2T4SeHt
References sheet: https://bit.ly/bitter-lesson
Lex + AI Podcast Discord: https://discord.gg/8RwBPRs
OUTLINE:
0:00 - Overview
0:37 - Bitter Lesson by Rich Sutton
6:55 - Contentions and opposing views
9:10 - Is evolution a part of search, learning, or something else?
10:51 - Bitter Lesson argument summary
11:42 - Moore's Law
13:37 - Global compute capacity
15:43 - Massively parallel computation
16:41 - GPUs and ASICs
17:17 - Quantum computing and neuromorphic computing
19:25 - Neuralink and brain-computer interfaces
21:28 - Deep learning efficiency
22:57 - Open questions for exponential improvement of AI
28:22 - Conclusion
CONNECT:
- Subscribe to this YouTube channel
- Twitter: https://twitter.com/lexfridman
- LinkedIn: https://www.linkedin.com/in/lexfridman
- Facebook: https://www.facebook.com/lexfridman
- Instagram: https://www.instagram.com/lexfridman
- Medium: https://medium.com/@lexfridman
Видео Exponential Progress of AI: Moore's Law, Bitter Lesson, and the Future of Computation канала Lex Fridman
Bitter Lesson: http://www.incompleteideas.net/IncIdeas/BitterLesson.html
Slides for this video: https://bit.ly/2T4SeHt
References sheet: https://bit.ly/bitter-lesson
Lex + AI Podcast Discord: https://discord.gg/8RwBPRs
OUTLINE:
0:00 - Overview
0:37 - Bitter Lesson by Rich Sutton
6:55 - Contentions and opposing views
9:10 - Is evolution a part of search, learning, or something else?
10:51 - Bitter Lesson argument summary
11:42 - Moore's Law
13:37 - Global compute capacity
15:43 - Massively parallel computation
16:41 - GPUs and ASICs
17:17 - Quantum computing and neuromorphic computing
19:25 - Neuralink and brain-computer interfaces
21:28 - Deep learning efficiency
22:57 - Open questions for exponential improvement of AI
28:22 - Conclusion
CONNECT:
- Subscribe to this YouTube channel
- Twitter: https://twitter.com/lexfridman
- LinkedIn: https://www.linkedin.com/in/lexfridman
- Facebook: https://www.facebook.com/lexfridman
- Instagram: https://www.instagram.com/lexfridman
- Medium: https://medium.com/@lexfridman
Видео Exponential Progress of AI: Moore's Law, Bitter Lesson, and the Future of Computation канала Lex Fridman
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Richard Dawkins: Evolution, Intelligence, Simulation, and Memes | Lex Fridman Podcast #87Humans will destroy ourselves in 100 years with 50% probability | Max Tegmark and Lex FridmanEscaping the Local Optimum of Low ExpectationThe History of Moore's Law (My Predictions) | Computer ScienceStephen Wolfram: What is Computation? | AI Podcast ClipsRole of Emotion in the Mind (Joscha Bach) | AI Podcast ClipsLeonard Susskind: Quantum Mechanics, String Theory and Black Holes | Lex Fridman Podcast #41Nuclear Fusion Energy | Ian Hutchinson and Lex FridmanCivilization might collapse at any moment | Sheldon Solomon and Lex FridmanThe machine code of the universe is discrete | Stephen Wolfram and Lex FridmanLex Fridman statement on Vladimir Putin and War in UkraineWill human civilization destroy itself? | Dan Carlin and Lex FridmanWhy we might be alone in the universe | Max Tegmark and Lex FridmanSam Harris: Meaning of LifeUFO sightings | Alex Filippenko and Lex FridmanAva's Smile: Ex Machina's Most Important Moment (Alex Garland) | AI Podcast ClipsDavid Chalmers: What is Consciousness? | AI Podcast ClipsTravel faster than speed of light by hacking the machine code of the universe | Stephen WolframElon Musk: Advice for Young People | Lex Fridman Podcast Clips