Jeff Hawkins: Thousand Brains Theory of Intelligence | Lex Fridman Podcast #25

Theory Overview

Jeff Hawkins introduces the Thousand Brains Theory of Intelligence, a revolutionary concept in understanding how the brain models the world. He explains that the neocortex uses reference frames to predict sensory experiences, such as feeling a coffee cup, by knowing the relative position of the finger to the cup 1. This theory suggests that intelligence arises from thousands of models working simultaneously, each contributing to a comprehensive understanding of objects and concepts 2.

The neocortex has a reference frame that's anchored to the cup because otherwise I wouldn't be able to say the location and I wouldn't be able to predict my new location.

--- Jeff Hawkins

Hawkins highlights the importance of understanding these models to solve complex problems in neuroscience 3.

   

Distributed Intelligence

The Thousand Brains Theory proposes a distributed model of intelligence, where multiple models of perception work together to form a cohesive understanding of objects. Hawkins describes how different sensory inputs, like touch and vision, create numerous models of an object, such as a coffee cup, which then vote to determine the object's identity 4. This process, known as sensor fusion, does not consolidate into a single model but relies on a network of interconnected models 5.

All these little columns in the cortex are all trying to guess what it is that they're sensing.

--- Jeff Hawkins

This distributed approach allows for dynamic attention and understanding of complex environments, as the brain navigates through nested structures of information 6.

   

Reference Frames

Reference frames play a crucial role in the Thousand Brains Theory, providing a framework for the brain to organize and interpret sensory data. Hawkins explains that every part of the neocortex uses reference frames to store and process information, allowing for the creation of detailed models of objects 7. These frames are not limited to physical space but extend to abstract concepts, enabling complex cognitive processes like mathematical reasoning 8.

The brain works by assigning everything, every input, to reference frames.

--- Jeff Hawkins

This innovative perspective shifts the understanding of the neocortex from a sensory processor to a sophisticated system of reference frames, each contributing to a comprehensive model of the world 9.