Statistical Models of Natural Images and Cortical Visual Representation

A fundamental question in visual neuroscience is: Why are the response properties of visual neurons as they are? A modern approach to this problem emphasizes the importance of adaptation to ecologically valid input, and it proceeds by modeling statistical regularities in ecologically valid visual input (natural images). A seminal model was linear sparse coding, which is equivalent to independent component analysis (ICA), and provided a very good description of the receptive fields of simple cells. Further models based on modeling residual dependencies of the "independent" components have later been introduced. These models lead to emergence of further properties of visual neurons: the complex cell receptive fields, the spatial organization of the cells, and some surround suppression and Gestalt effects. So far, these models have concentrated on the response properties of neurons, but they hold great potential to model various forms of inference and learning.