Perceptual Mechanisms of Material Properties

Human vision effortlessly distinguishes a vast array of materials—from the gleam of polished metal to the soft drape of fabric—by analysing optical, mechanical and dynamic cues. Optical properties such as surface reflectance, gloss and translucency arise from interactions between light, illumination geometry and object shape. Mechanical and fluid properties, including stiffness and viscosity, manifest through characteristic deformations and motion patterns. The visual system integrates static image features (for example intensity gradients and specular highlights) with dynamic information (such as multiframe motion trajectories and shape changes) to infer distal material qualities. This perceptual machinery not only supports everyday tasks like grasping and surface inspection but also underpins developments in robotics, virtual reality and computer graphics. Recent work emphasises the interdependence of recognition and property estimation, revealing that cues for gloss, colour and texture contribute jointly to material categorisation rather than operating in isolation.

Research from Nature Portfolio

Recent studies have demonstrated that the fine structure of specular reflections drives both gloss perception and material classification. By systematically manipulating the distribution and sharpness of highlights on complex objects, researchers showed that variations in specular image structure induce categorical shifts in perceived material class, indicating that categorisation and gloss estimation are intertwined processes. In parallel, advances in unsupervised learning reveal how statistical regularities in proximal images can underpin human gloss judgements. Generative neural models trained without explicit labels spontaneously organise renderings of glossy surfaces according to underlying reflectance and illumination. Remarkably, the internal representations of these models predict patterns of human perceptual “successes” and “errors” when assessing gloss, suggesting that an unsupervised learning framework may mirror the brain’s strategy for disentangling material properties from confounding optical factors.

Perceptual Mechanisms of Material Properties publication trend

The graph below shows the total number of articles in perceptual mechanisms of material properties across all publications each year (not limited to Nature Index journals).

Technical terms

Specular reflection: Mirror-like reflection of light at a surface that produces highlights and sharp intensity gradients.

Gloss: Perceived shininess of a surface determined by the intensity and distribution of specular reflections.

Translucency: Degree to which light penetrates and scatters within a material, influencing its perceived softness or opacity.

Midlevel visual features: Intermediate representations—such as surface curvature, motion irregularity and outline complexity—that support material discrimination.

Generative neural network: Unsupervised learning model that captures statistical structure of input images and can generate or cluster new examples according to learned properties.

References

1. Material category of visual objects computed from specular image structure. Nature Human Behaviour (2023).
2. Unsupervised learning predicts human perception and misperception of gloss. Nature Human Behaviour (2021).
3. Visual Features in the Perception of Liquids. Current Biology (2018).
4. Estimating mechanical properties of cloth from videos using dense motion trajectories: Human psychophysics and machine learning. Journal of Vision (2018).
5. Effects of Shape, Roughness and Gloss on the Perceived Reflectance of Colored Surfaces. Frontiers in Psychology (2020).
6. Joint Effects of Illumination Geometry and Object Shape in the Perception of Surface Reflectance. i-Perception (2011).
7. Material and shape perception based on two types of intensity gradient information. PLOS Computational Biology (2018).