Representation learning in the artificial and biological neural networks underlying sensorimotor integration

The integration of deep learning and theories of reinforcement learning (RL) is a promising avenue to explore novel hypotheses on reward-based learning and decision-making in humans and other animals. Here, we trained deep RL agents and mice in the same sensorimotor task with high-dimensional state and action space and studied representation learning in their respective neural networks. Evaluation of thousands of neural network models with extensive hyperparameter search revealed that learning-dependent enrichment of state-value and policy representations of the task-performance-optimized deep RL agent closely resembled neural activity of the posterior parietal cortex (PPC). These representations were critical for the task performance in both systems. PPC neurons also exhibited representations of the internally defined subgoal, a feature of deep RL algorithms postulated to improve sample efficiency. Such striking resemblance between the artificial and biological networks and their functional convergence in sensorimotor integration offers new opportunities to better understand respective intelligent systems. Ministry of Education (MOE) Nanyang Technological University Published version This work was supported by the NARSAD Young Investigator Grant, the Brain & Behavior Research Foundation (to H.M.); Nanyang Assistant Professorship, Nanyang Technological University (to H.M.); Singapore Ministry of Education Academic Research Fund Tier 1 2018-T1-001-032 (to H.M.); Singapore Ministry of Education Academic Research Fund Tier 1 RT11/19 (to H.M.); Singapore Ministry of Education Academic Research Fund Tier 2 MOE2018-T2-1-021 (to H.M.); and Singapore Ministry of Education Academic Research Fund Tier 3 MOE2017-T3-1-002 (to H.M.)