Fig. 1: Reasons for efficient coding.
From: Efficient neural codes naturally emerge through gradient descent learning
a One consequence of efficient coding is that perceptual sensitivity reflects the empirical frequency of perceptual variables. b Efficient coding can be justified normatively as the most effective way to allocate finite neural resources to encode a stimulus ensemble. In this work we describe a mechanism for efficient coding due to learning components of the inputs at different rates dependent on their frequency.
