Fig. 5: Dynamics in the first layer of a two-hidden-layer sigmoidal network.
From: Coding schemes in neural networks learning classification tasks
a Preactivation dynamics of selected first layer neurons on the first training input during sampling. b, c Activations of all neurons using first (b) and last (c) weight sample. d Reordered activations shown in c. preact., preactivation.
