Selective IT neurons are selective along many dimensions

Our visual abilities are unsurpassed because of a sophisticated code for objects located in the inferior temporal (IT) cortex. This code has remained a mystery because IT neurons show extremely diverse shape selectivity with no apparent organizing principle. Here, we show that there is an intrinsic component to selectivity in IT neurons. We tested IT neurons on distinct shapes and their parametric variations and asked whether neurons selective along one dimension were also selective along others. Selective neurons responded to fewer shapes and were narrowly tuned to local variations of these shapes, both along arbitrary morph lines and along variations in size, position, or orientation. For a subset of neurons, selective neurons were selective for both shape and texture. Finally, selective neurons were also more invariant in that they preserved their shape preferences across changes in size, position, and orientation. These observations indicate that there is an intrinsic constraint on the sharpness of tuning for the features coded by each IT neuron, making it always sharply tuned or always broadly tuned along all dimensions. We speculate that this may be an organizing principle throughout visual cortex.