Brain Inspired

David, John, and I discuss the role of complexity science in the study of intelligence. In this first part, we talk about complexity itself, its role in neuroscience, emergence and levels of explanation, understanding, epistemology and ontology, and really quite a bit more.

Notes:

• David’s page at the Santa Fe Institute.
• John’s BLAM lab website.
• Follow SFI on twitter: @sfiscience.
• BLAM on Twitter: @blamlab
• Related Krakauer stuff:
  • At the limits of thought. An Aeon article by David
  • Complex Time: Cognitive Regime Shift II - When/Why/How the Brain Breaks. A video conversation with both John and David.
  • Complexity Podcast.
• Books mentioned:
  • Worlds Hidden in Plain Sight: The Evolving Idea of Complexity at the Santa Fe Institute, ed. David Krakauer.
  • Understanding Scientific Understanding by Henk de Regt.
  • The Idea of the Brain by Matthew Cobb.
  • New Dark Age: Technology and the End of the Future by James Bridle.
  • The River of Consciousness by Oliver Sacks.

Announcement:

I'm releasing my Neuro-AI course April 10-13, after which it will be closed for some time. Learn more here.

Support the show to get full episodes and join the Discord community.

Ila discusses her theoretical neuroscience work suggesting how our memories are formed within the cognitive maps we use to navigate the world and navigate our thoughts. The main idea is that grid cell networks in the entorhinal cortex internally generate a structured scaffold, which gets sent to the hippocampus. Neurons in the hippocampus, like the well-known place cells, receive that scaffolding and also receive external signals from the neocortex- signals about what's happening in the world and in our thoughts. Thus, the place cells act to "pin" what's happening in our neocortex to the scaffold, forming a memory. We also discuss her background as a physicist and her approach as a "neurophysicist", and a review she's publishing all about the many brain areas and cognitive functions being explained as attractor landscapes within a dynamical systems framework.

• The Fiete Lab.
• Related papers
  • A structured scaffold underlies activity in the hippocampus.
  • Attractor and integrator networks in the brain.

0:00 - Intro 3:36 - "Neurophysicist" 9:30 - Bottom-up vs. top-down 15:57 - Tool scavenging 18:21 - Cognitive maps and hippocampus 22:40 - Hopfield networks 27:56 - Internal scaffold 38:42 - Place cells 43:44 - Grid cells 54:22 - Grid cells encoding place cells 59:39 - Scaffold model: stacked hopfield networks 1:05:39 - Attractor landscapes 1:09:22 - Landscapes across scales 1:12:27 - Dimensionality of landscapes

Support the show to get full episodes and join the Discord community.

Check out my free video series about what's missing in AI and Neuroscience

Ken discusses the recent work in his lab that allows communication with subjects while they experience lucid dreams. This new paradigm opens many avenues to study the neuroscience and psychology of consciousness, sleep, dreams, memory, and learning, and to improve and optimize sleep for cognition. Ken and his team are developing a Lucid Dreaming App which is freely available via his lab. We also discuss much of his work on memory and learning in general and specifically related to sleep, like reactivating specific memories during sleep to improve learning.

• Ken's Cognitive Neuroscience Laboratory.
• Twitter: @kap101.
• The Lucid Dreaming App.
• Related papers
  • Memory and Sleep: How Sleep Cognition Can Change the Waking Mind for the Better.
  • Does memory reactivation during sleep support generalization at the cost of memory specifics?
  • Real-time dialogue between experimenters and dreamers during REM sleep.

0:00 - Intro 2:48 - Background and types of memory 14:44 -Consciousness and memory 23:32 - Phases and sleep and wakefulness 28:19 - Sleep, memory, and learning 33:50 - Targeted memory reactivation 48:34 - Problem solving during sleep 51:50 - 2-way communication with lucid dreamers 1:01:43 - Confounds to the paradigm 1:04:50 - Limitations and future studies 1:09:35 - Lucid dreaming app 1:13:47 - How sleep can inform AI 1:20:18 - Advice for students

Support the show to get full episodes and join the Discord community.

Check out my free video series about what's missing in AI and Neuroscience

Michel Bitbol is Director of Research at CNRS (Centre National de la Recherche Scientifique). Alex Gomez-Marin is a neuroscientist running his lab, The Behavior of Organisms Laboratory, at the Instituto de Neurociencias in Alicante. We discuss phenomenology as an alternative perspective on our scientific endeavors. Although we like to believe our science is objective and explains the reality of the world we inhabit, we can't escape the fact that all of our scientific knowledge comes through our perceptions and interpretations as conscious living beings. Michel has used phenomenology to resolve many of the paradoxes that quantum mechanics generates when it is understood as a description of reality, and more recently he has applied phenomenology to the philosophy of mind and consciousness. Alex is currently trying to apply the phenomenological approach to his research on brains and behavior. Much of our conversation revolves around how phenomenology and our "normal" scientific explorations can co-exist, including the study of minds, brains, and intelligence- our own and that of other organisms. We also discuss the "blind spot" of science, the history and practice of phenomenology, various kinds of explanation, the language we use to describe things, and more.

• Michel's website
• Alex's Lab: The Behavior of Organisms Laboratory.
• Twitter: @behaviOrganisms (Alex)
• Related papers
  • The Blind Spot of Neuroscience
  • The Life of Behavior
  • A Clash of Umwelts
• Related events:
  • The Future Scientist (a conversation series)

0:00 - Intro 4:32 - The Blind Spot 15:53 - Phenomenology and interpretation 22:51 - Personal stories: appreciating phenomenology 37:42 - Quantum physics example 47:16 - Scientific explanation vs. phenomenological description 59:39 - How can phenomenology and science complement each other? 1:08:22 - Neurophenomenology 1:17:34 - Use of language 1:25:46 - Mutual constraints

Support the show to get full episodes and join the Discord community.

Patryk and I discuss his wide-ranging background working in both the neuroscience and AI worlds, and his resultant perspective on what's needed to move forward in AI, including some principles of brain processes that are more and less important. We also discuss his own work using some of those principles to help deep learning generalize to better capture how humans behave in and perceive the world.

• Patryk's homepage.
• Twitter: @paklnet.
• Related papers
  • Unsupervised Learning from Continuous Video in a Scalable Predictive Recurrent Network.

0:00 - Intro 2:22 - Patryk's background 8:37 - Importance of diverse skills 16:14 - What is intelligence? 20:34 - Important brain principles 22:36 - Learning from the real world 35:09 - Language models 42:51 - AI contribution to neuroscience 48:22 - Criteria for "real" AI 53:11 - Neuroscience for AI 1:01:20 - What can we ignore about brains? 1:11:45 - Advice to past self