Spotlight Poster
Nonlinear dynamics of localization in neural receptive fields
Leon Lufkin · Andrew Saxe · Erin Grant
Localized receptive fields—neurons that are selective for certain contiguous spatiotemporal features of their input—populate early sensory regions of the mammalian brain. Unsupervised learning algorithms that optimize explicit sparsity or independence criteria replicate features of these localized receptive fields, but fail to explain directly how localization arises through learning without efficient coding, as occurs in early layers of deep neural networks and might occur in early sensory regions of biological systems. We consider an alternative model in which localized receptive fields emerge without explicit top-down efficiency constraints—a feedforward neural network trained on a task inspired by the structure of natural images. Previous work identified the importance of non-Gaussian statistics to obtaining localization in this model but left open questions about the mechanisms driving dynamical emergence. We address this by deriving the effective learning dynamics for a single nonlinear neuron, making precise how higher-order statistical properties of the input data drive emergent localization, and we demonstrate that the predictions of these effective dynamics extend to the many-neuron setting. Our analysis provides an alternative explanation for the ubiquity of localization as resulting from nonlinear computation and learning in neural circuits.
Live content is unavailable. Log in and register to view live content