Professor Matt Botvinick: Google

Formerly Professor of Psychology and the Princeton Neuroscience Institute and now of DeepMind and Gatsby Computational Neuroscience Unit, UCL, London, U.K

Over the past twenty years, neuroscience research on reward-based learning has converged on a canonical model, under which the neurotransmitter dopamine ‘stamps in’ associations between situations, actions and rewards by modulating the strength of synaptic connections between neurons. However, a growing number of recent findings have placed this standard model under strain. In the present work, we draw on recent advances in artificial intelligence to introduce a new theory of reward-based learning. Here, the dopamine system trains another part of the brain, the prefrontal cortex, to operate as its own free-standing learning system. This new perspective accommodates the findings that motivated the standard model, but also deals gracefully with a wider range of observations, providing a fresh foundation for future research.

Hosted by Elliot Ludvig

Refreshments 3.30pm in Common Room