#59 JEFF HAWKINS - Thousand Brains Theory
Patreon: https://www.patreon.com/mlst
The ultimate goal of neuroscience is to learn how the human brain gives rise to human intelligence and what it means to be intelligent. Understanding how the brain works is considered one of humanity’s greatest challenges.
Jeff Hawkins thinks that the reality we perceive is a kind of simulation, a hallucination, a confabulation. He thinks that our brains are a model reality based on thousands of information streams originating from the sensors in our body. Critically - Hawkins doesn’t think there is just one model but rather; thousands.
Jeff has just released his new book, A thousand brains: a new theory of intelligence. It’s an inspiring and well-written book and I hope after watching this show; you will be inspired to read it too.
Pod version: https://anchor.fm/machinelearningstreettalk/episodes/59---Jeff-Hawkins-Thousand-Brains-Theory-e16sb64
https://numenta.com/a-thousand-brains-by-jeff-hawkins/
https://numenta.com/blog/2019/01/16/the-thousand-brains-theory-of-intelligence/
https://numenta.com/assets/pdf/research-publications/papers/Sparsity-Enables-50x-Performance-Acceleration-Deep-Learning-Networks.pdf
https://numenta.com/neuroscience-research/research-publications/papers/a-framework-for-intelligence-and-cortical-function-based-on-grid-cells-in-the-neocortex/
Your Brain Is Not an Onion With a Tiny Reptile Inside
https://journals.sagepub.com/doi/full/10.1177/0963721420917687
Pruning Neural Networks at Initialization: Why are We Missing the Mark?
https://arxiv.org/abs/2009.08576
Panel:
Dr. Tim Scarfe
Dr. Keith Duggar https://twitter.com/DoctorDuggar
Connor Leahy https://twitter.com/npcollapse
Our thanks to:
Numenta
Matthieu Thiboust (https://www.insightsfromthebrain.com/ + https://twitter.com/mthiboust)
Shwetha Bharadwaj (show research https://www.linkedin.com/in/shwetha-bharadwaj-2b926a1b2/)
Andreas Koepf (show research https://twitter.com/neurosp1ke?lang=en)
Lex Fridman, we used a few clips from his Jeffv2 interview -- https://www.youtube.com/watch?v=Z1KwkpTUbkg -- remember to check Lex's channel out! ❤
[00:00:00] Introduction
[00:03:03] The Neocortex
[00:09:58] Triune Brain
[00:12:24] Grid and place cells
[00:14:54] Reference frames
[00:21:03] Mountcastle
[00:25:46] Thousand brains theory of intelligence
[00:32:40] HTM
[00:41:12] Sparsity
[00:52:57] Main show kick off
[00:54:36] Tribalism in the ML Community
[00:57:14] Variation in approaches to the same goal
[00:59:43] Hawkins ideas validated, cortical uniformity
[01:02:25] Sparse distributed representations (SDRs)
[01:06:08] Reference frames as generalization
[01:10:29] Reference frame remapping
[01:14:14] Reference frames can generalize beyond three dimensions
[01:17:26] And generalize beyond spatial topology
[01:20:12] Intuitions behind why SDRs work well
[01:24:03] Are their capacity concerns with the SDR model
[01:27:11] At what level between GOFAI and Connectionism should focus our effort?
[01:31:33] The brain reasons by abstract movement through reference frames
[01:35:34] Human's don't know Universal Truth (if there is even such a thing)
[01:37:34] Learning elsewhere in the brain besides the neocortex
[01:40:44] Stochastic backpropagation in the human brain
[01:44:04] What's missing from artificial neural networks? Numenta's roadmap
[01:48:59] AGI Risk - the alignment problem
[01:54:07] AGI risk - the neocortex can thwart the old brain
[01:57:47] AGI risk - artificial evolution
[02:01:18] AGI risk - yes we need to think on and develop adequate control systems
[02:03:48] A balance of knowledge: innate, experiential, taught, or deduced
[02:16:09] post-show wrap-up
[02:16:59] Advancements in direction at Numenta
[02:19:50] AGI risk recap
[02:23:56] Ought did evolve from Is, humans are the proof
[02:26:29] When AGI overcomes our weaknesses
[02:28:54] Who doesn't like forking?!
[02:30:29] Coherent synchronization as a measure of identity
#machinelearning #artificialintelligence
Music credit;
https://soundcloud.com/calicry/nolightwithoutdark
https://soundcloud.com/sibewest/sibewest-nero
https://soundcloud.com/immnnt/skeler-kensho
https://soundcloud.com/hypeerbeats/s-o-l-a-r-i-s
https://soundcloud.com/vskymusic/empty
https://soundcloud.com/zeitfall/moment
https://soundcloud.com/prodjai/reticent
https://soundcloud.com/blazingbeatzz/velvet
https://soundcloud.com/sekai-collective/c-a-l-i-c-r-y-lalala
https://soundcloud.com/mattlange/sets/ephemera
https://soundcloud.com/mrsuicidesheep/elo-method-subranger-solace
https://soundcloud.com/ukowens1
https://soundcloud.com/vskymusic/sets/nightwalk
https://soundcloud.com/calicry/be-here
https://soundcloud.com/xxxxzomb/divine
Видео #59 JEFF HAWKINS - Thousand Brains Theory канала Machine Learning Street Talk
The ultimate goal of neuroscience is to learn how the human brain gives rise to human intelligence and what it means to be intelligent. Understanding how the brain works is considered one of humanity’s greatest challenges.
Jeff Hawkins thinks that the reality we perceive is a kind of simulation, a hallucination, a confabulation. He thinks that our brains are a model reality based on thousands of information streams originating from the sensors in our body. Critically - Hawkins doesn’t think there is just one model but rather; thousands.
Jeff has just released his new book, A thousand brains: a new theory of intelligence. It’s an inspiring and well-written book and I hope after watching this show; you will be inspired to read it too.
Pod version: https://anchor.fm/machinelearningstreettalk/episodes/59---Jeff-Hawkins-Thousand-Brains-Theory-e16sb64
https://numenta.com/a-thousand-brains-by-jeff-hawkins/
https://numenta.com/blog/2019/01/16/the-thousand-brains-theory-of-intelligence/
https://numenta.com/assets/pdf/research-publications/papers/Sparsity-Enables-50x-Performance-Acceleration-Deep-Learning-Networks.pdf
https://numenta.com/neuroscience-research/research-publications/papers/a-framework-for-intelligence-and-cortical-function-based-on-grid-cells-in-the-neocortex/
Your Brain Is Not an Onion With a Tiny Reptile Inside
https://journals.sagepub.com/doi/full/10.1177/0963721420917687
Pruning Neural Networks at Initialization: Why are We Missing the Mark?
https://arxiv.org/abs/2009.08576
Panel:
Dr. Tim Scarfe
Dr. Keith Duggar https://twitter.com/DoctorDuggar
Connor Leahy https://twitter.com/npcollapse
Our thanks to:
Numenta
Matthieu Thiboust (https://www.insightsfromthebrain.com/ + https://twitter.com/mthiboust)
Shwetha Bharadwaj (show research https://www.linkedin.com/in/shwetha-bharadwaj-2b926a1b2/)
Andreas Koepf (show research https://twitter.com/neurosp1ke?lang=en)
Lex Fridman, we used a few clips from his Jeffv2 interview -- https://www.youtube.com/watch?v=Z1KwkpTUbkg -- remember to check Lex's channel out! ❤
[00:00:00] Introduction
[00:03:03] The Neocortex
[00:09:58] Triune Brain
[00:12:24] Grid and place cells
[00:14:54] Reference frames
[00:21:03] Mountcastle
[00:25:46] Thousand brains theory of intelligence
[00:32:40] HTM
[00:41:12] Sparsity
[00:52:57] Main show kick off
[00:54:36] Tribalism in the ML Community
[00:57:14] Variation in approaches to the same goal
[00:59:43] Hawkins ideas validated, cortical uniformity
[01:02:25] Sparse distributed representations (SDRs)
[01:06:08] Reference frames as generalization
[01:10:29] Reference frame remapping
[01:14:14] Reference frames can generalize beyond three dimensions
[01:17:26] And generalize beyond spatial topology
[01:20:12] Intuitions behind why SDRs work well
[01:24:03] Are their capacity concerns with the SDR model
[01:27:11] At what level between GOFAI and Connectionism should focus our effort?
[01:31:33] The brain reasons by abstract movement through reference frames
[01:35:34] Human's don't know Universal Truth (if there is even such a thing)
[01:37:34] Learning elsewhere in the brain besides the neocortex
[01:40:44] Stochastic backpropagation in the human brain
[01:44:04] What's missing from artificial neural networks? Numenta's roadmap
[01:48:59] AGI Risk - the alignment problem
[01:54:07] AGI risk - the neocortex can thwart the old brain
[01:57:47] AGI risk - artificial evolution
[02:01:18] AGI risk - yes we need to think on and develop adequate control systems
[02:03:48] A balance of knowledge: innate, experiential, taught, or deduced
[02:16:09] post-show wrap-up
[02:16:59] Advancements in direction at Numenta
[02:19:50] AGI risk recap
[02:23:56] Ought did evolve from Is, humans are the proof
[02:26:29] When AGI overcomes our weaknesses
[02:28:54] Who doesn't like forking?!
[02:30:29] Coherent synchronization as a measure of identity
#machinelearning #artificialintelligence
Music credit;
https://soundcloud.com/calicry/nolightwithoutdark
https://soundcloud.com/sibewest/sibewest-nero
https://soundcloud.com/immnnt/skeler-kensho
https://soundcloud.com/hypeerbeats/s-o-l-a-r-i-s
https://soundcloud.com/vskymusic/empty
https://soundcloud.com/zeitfall/moment
https://soundcloud.com/prodjai/reticent
https://soundcloud.com/blazingbeatzz/velvet
https://soundcloud.com/sekai-collective/c-a-l-i-c-r-y-lalala
https://soundcloud.com/mattlange/sets/ephemera
https://soundcloud.com/mrsuicidesheep/elo-method-subranger-solace
https://soundcloud.com/ukowens1
https://soundcloud.com/vskymusic/sets/nightwalk
https://soundcloud.com/calicry/be-here
https://soundcloud.com/xxxxzomb/divine
Видео #59 JEFF HAWKINS - Thousand Brains Theory канала Machine Learning Street Talk
Показать
Комментарии отсутствуют
Информация о видео
3 сентября 2021 г. 22:48:50
02:35:06
Другие видео канала
Getting ready for Dr Thomas Parr interview, watch it first on Patreon!#035 Christmas Community Edition!Prof. Simon Prince on factor graphsJordan Edwards: ML Engineering and DevOps on AzureMLCapsule Networks and EducationLuciano Floridi on the ramifications of working in AI #machineleaning #artificialintelligence#94 - ALAN CHAN - AI Alignment and Governance #NEURIPS#62 Dr. GUY EMERSON [Unplugged]Riddhi Jain Pitliya on virtual agents and memes #aiDr. THOMAS PARR - Active InferenceProf. Sepp Hochreiter: A Pioneer in Deep Learning#83 Dr. ANDREW LAMPINEN (Deepmind) - Natural Language, Symbols and Grounding [NEURIPS2022 UNPLUGGED]#063 - Prof. YOSHUA BENGIO - GFlowNets, Consciousness & CausalityLeetcode Challenge with DeepMind & Mila Scientists!SWaV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments (Mathilde Caron)#71 - ZAK JOST (Graph Neural Networks + Geometric DL) [UNPLUGGED]#85 Dr. Petar Veličković (Deepmind) - Categories, Graphs, Reasoning [NEURIPS22 UNPLUGGED]#036 - Max Welling: Quantum, Manifolds & Symmetries in ML#52 - Dr. HADI SALMAN - Adversarial Examples Beyond Security [MIT]Dr. Minqi Jiang on curriculum learningThe Lottery Ticket Hypothesis with Jonathan Frankle