Unfolding the Black Box of Recurrent Neural Networks for Path Integration

Neil Burgess (University College London) · Si Wu (Peking University) · Tianhao Chu (Peking University) · Yuling Wu (Peking University) · Zilong Ji (Institute of cognitive neuroscience, University College London)
2d spaceattractor frameworkband cellscontinuous attractor neural networksgrid cellshierarchical information processinginformation flowsinternal dynamicsneural circuit modelneural correlatespath integrationpruning connectionsreceptive fieldsrecurrent neural networksvelocity information

Path integration is essential for spatial navigation. Experimental studies have identified neural correlates for path integration, but exactly how the neural system accomplishes this computation remains unresolved. Here, we adopt recurrent neural networks (RNNs) trained to perform a path integration task to explore this issue. After training, we borrow neuroscience prior knowledge and methods to unfold the black box of the trained model, including: clarifying neuron types based on their receptive fields, dissecting information flows between neuron groups by pruning their connections, and analyzing internal dynamics of neuron groups using the attractor framework. Intriguingly, we uncover a hierarchical information processing pathway embedded in the RNN model, along which velocity information of an agent is first forwarded to band cells, band and grid cells then coordinate to carry out path integration, and finally grid cells output the agent location. Inspired by the RNN-based study, we construct a neural circuit model, in which band cells form one-dimensional (1D) continuous attractor neural networks (CANNs) and serve as upstream neurons to support downstream grid cells to carry out path integration in the 2D space. Our study challenges the conventional view of considering grid cells as the principal velocity integrator, and supports a neural circuit model with the hierarchy of band and grid cells.