BI 122 Kohitij Kar: Visual Intelligence
12/12/21 • 93 min
Support the show to get full episodes and join the Discord community.
Ko and I discuss a range of topics around his work to understand our visual intelligence. Ko was a postdoc in James Dicarlo's lab, where he helped develop the convolutional neural network models that have become the standard for explaining core object recognition. He is starting his own lab at York University, where he will continue to expand and refine the models, adding important biological details and incorporating models for brain areas outside the ventral visual stream. He will also continue recording neural activity, and performing perturbation studies to better understand the networks involved in our visual cognition.
- VISUAL INTELLIGENCE AND TECHNOLOGICAL ADVANCES LAB
- Twitter: @KohitijKar.
- Related papers
- BI 075 Jim DiCarlo: Reverse Engineering Vision
0:00 - Intro 3:49 - Background 13:51 - Where are we in understanding vision? 19:46 - Benchmarks 21:21 - Falsifying models 23:19 - Modeling vs. experiment speed 29:26 - Simple vs complex models 35:34 - Dorsal visual stream and deep learning 44:10 - Modularity and brain area roles 50:58 - Chemogenetic perturbation, DREADDs 57:10 - Future lab vision, clinical applications 1:03:55 - Controlling visual neurons via image synthesis 1:12:14 - Is it enough to study nonhuman animals? 1:18:55 - Neuro/AI intersection 1:26:54 - What is intelligence?
Support the show to get full episodes and join the Discord community.
Ko and I discuss a range of topics around his work to understand our visual intelligence. Ko was a postdoc in James Dicarlo's lab, where he helped develop the convolutional neural network models that have become the standard for explaining core object recognition. He is starting his own lab at York University, where he will continue to expand and refine the models, adding important biological details and incorporating models for brain areas outside the ventral visual stream. He will also continue recording neural activity, and performing perturbation studies to better understand the networks involved in our visual cognition.
- VISUAL INTELLIGENCE AND TECHNOLOGICAL ADVANCES LAB
- Twitter: @KohitijKar.
- Related papers
- BI 075 Jim DiCarlo: Reverse Engineering Vision
0:00 - Intro 3:49 - Background 13:51 - Where are we in understanding vision? 19:46 - Benchmarks 21:21 - Falsifying models 23:19 - Modeling vs. experiment speed 29:26 - Simple vs complex models 35:34 - Dorsal visual stream and deep learning 44:10 - Modularity and brain area roles 50:58 - Chemogenetic perturbation, DREADDs 57:10 - Future lab vision, clinical applications 1:03:55 - Controlling visual neurons via image synthesis 1:12:14 - Is it enough to study nonhuman animals? 1:18:55 - Neuro/AI intersection 1:26:54 - What is intelligence?
Previous Episode
BI 121 Mac Shine: Systems Neurobiology
Support the show to get full episodes, full archive, and join the Discord community.
Mac and I discuss his systems level approach to understanding brains, and his theoretical work suggesting important roles for the thalamus, basal ganglia, and cerebellum, shifting the dynamical landscape of brain function within varying behavioral contexts. We also discuss his recent interest in the ascending arousal system and neuromodulators. Mac thinks the neocortex has been the sole focus of too much neuroscience research, and that the subcortical brain regions and circuits have a much larger role underlying our intelligence.
- Shine Lab
- Twitter: @jmacshine
- Related papers
0:00 - Intro 6:32 - Background 10:41 - Holistic approach 18:19 - Importance of thalamus 35:19 - Thalamus circuitry 40:30 - Cerebellum 46:15 - Predictive processing 49:32 - Brain as dynamical attractor landscape 56:48 - System 1 and system 2 1:02:38 - How to think about the thalamus 1:06:45 - Causality in complex systems 1:11:09 - Clinical applications 1:15:02 - Ascending arousal system and neuromodulators 1:27:48 - Implications for AI 1:33:40 - Career serendipity 1:35:12 - Advice
Next Episode
BI 123 Irina Rish: Continual Learning
Support the show to get full episodes, full archive, and join the Discord community.
Irina is a faculty member at MILA-Quebec AI Institute and a professor at Université de Montréal. She has worked from both ends of the neuroscience/AI interface, using AI for neuroscience applications, and using neural principles to help improve AI. We discuss her work on biologically-plausible alternatives to back-propagation, using "auxiliary variables" in addition to the normal connection weight updates. We also discuss the world of lifelong learning, which seeks to train networks in an online manner to improve on any tasks as they are introduced. Catastrophic forgetting is an obstacle in modern deep learning, where a network forgets old tasks when it is trained on new tasks. Lifelong learning strategies, like continual learning, transfer learning, and meta-learning seek to overcome catastrophic forgetting, and we talk about some of the inspirations from neuroscience being used to help lifelong learning in networks.
- Irina's website.
- Twitter: @irinarish
- Related papers:
- Lifelong learning video tutorial: DLRL Summer School 2021 - Lifelong Learning - Irina Rish.
0:00 - Intro 3:26 - AI for Neuro, Neuro for AI 14:59 - Utility of philosophy 20:51 - Artificial general intelligence 24:34 - Back-propagation alternatives 35:10 - Inductive bias vs. scaling generic architectures 45:51 - Continual learning 59:54 - Neuro-inspired continual learning 1:06:57 - Learning trajectories
If you like this episode you’ll love
Episode Comments
Featured in these lists
Generate a badge
Get a badge for your website that links back to this episode
<a href="https://goodpods.com/podcasts/brain-inspired-206251/bi-122-kohitij-kar-visual-intelligence-21441963"> <img src="https://storage.googleapis.com/goodpods-images-bucket/badges/generic-badge-1.svg" alt="listen to bi 122 kohitij kar: visual intelligence on goodpods" style="width: 225px" /> </a>
Copy