Modern machine learning approaches, such as deep neural networks, generalize well despite interpolating noisy data, in contrast with textbook wisdom. Mitra describes the phenomenon of statistically consistent interpolation (SCI) to clarify why data interpolation succeeds, and discusses how SCI elucidates the differing approaches to modelling natural phenomena represented in modern machine learning, traditional physical theory and biological brains.
