Abstract
Robust averaging is an analytic feature of our perceptual systems that adaptively downweights outlying information during information processing. Here, we test whether individuals demonstrate robust averaging for a critical source of social information—facial affect—whether it is altered by psychotic-like experiences, and whether it is associated with social connection (the positive sense of relatedness from relationships and perceived/received support and inclusion). Participants completed a novel face averaging task in which they judged whether face arrays that varied as a function of reliability (variance of the faces), strength (emotional intensity of the faces), and valence (positive or negative), were on average more positive or negative. Afterwards, participants completed self-report measures of psychotic-like experiences and social connection. Two analytic approaches revealed the presence of robust averaging for emotional faces whereby inlying faces (i.e., those closer to the mean emotion expression of the face array) were given greater weight compared to outlying faces on trial-by-trial decisions. This effect was specific to high variance trials. There were no associations between robust averaging and social connection or psychotic-like experiences. These findings suggest individuals use robust averaging as an adaptive strategy to summarize social information, although any clinical and behavioral implications of individual differences remain to be clarified.
Similar content being viewed by others
Data availability
The datasets generated and analyzed during the current study are available in the Open Science Framework, https://osf.io/w596j/.
References
Haberman, J. & Whitney, D. The visual system discounts emotional deviants when extracting average expression. Atten. Percept. Psychophys. 72, 1825–1838 (2010).
Alvarez, G. A. Representing multiple objects as an ensemble enhances visual cognition. Trends Cogn. Sci. 15, 122–131 (2011).
Haberman, J. & Whitney, D. Rapid extraction of mean emotion and gender from sets of faces. Curr. Biol. 17, R751–R753 (2007).
Chong, S. C. & Treisman, A. Statistical processing: Computing the average size in perceptual groups. Vis. Res. 45, 891–900 (2005).
Ji, L., Chen, W., Loeys, T. & Pourtois, G. Ensemble representation for multiple facial expressions: Evidence for a capacity limited perceptual process. J. Vis. 18, 17 (2018).
Ji, L., Pourtois, G. & Sweeny, T. D. Averaging multiple facial expressions through subsampling. Vis. Cogn. 28, 41–58 (2020).
Awh, E., Barton, B. & Vogel, E. K. Visual working memory represents a fixed number of items regardless of complexity. Psychol. Sci. 18, 622–628 (2007).
Larsen, E. M. et al. Hallucination-proneness is associated with a decrease in robust averaging of perceptual evidence. Schizophr. Bull. 50, 59–68 (2024).
De Gardelle, V. & Summerfield, C. Robust averaging during perceptual judgment. Proc. Natl. Acad. Sci. U.S.A. 108, 13341–13346 (2011).
Parkes, L., Lund, J., Angelucci, A., Solomon, J. A. & Morgan, M. Compulsory averaging of crowded orientation signals in human vision. Nat. Neurosci. 4, 739–744 (2001).
Fischer, J. & Whitney, D. Object-level visual information gets through the bottleneck of crowding. J. Neurophysiol. 106, 1389–1398 (2011).
Mitchell, J. P. Social psychology as a natural kind. Trends Cogn. Sci. 13, 246–251 (2009).
Berkay, D. & Jenkins, A. C. A role for uncertainty in the neural distinction between social and nonsocial thought. Perspect. Psychol. Sci. 18, 491–502 (2023).
Whitney, D. & Yamanashi Leib, A. Ensemble perception. Annu. Rev. Psychol. 69, 105–129 (2018).
Haberman, J., Lee, P. & Whitney, D. Mixed emotions: Sensitivity to facial variance in a crowd of faces. J. Vis. 15, 16 (2015).
Mareschal, I., Otsuka, Y., Clifford, C. W. G. & Mareschal, D. “Are you looking at me?” How children’s gaze judgments improve with age. Dev. Psychol. 52, 695–703 (2016).
Sweeny, T. D. & Whitney, D. Perceiving crowd attention: Ensemble perception of a crowd’s gaze. Psychol. Sci. 25, 1903–1913 (2014).
Alvarez, G. A. & Oliva, A. Spatial ensemble statistics are efficient codes that can be represented with reduced attention. Proc. Natl. Acad. Sci. U.S.A. 106, 7345–7350 (2009).
Haberman, J. & Whitney, D. Seeing the mean: Ensemble coding for sets of faces. J. Exp. Psychol. Hum. Percept. Perform. 35, 718–734 (2009).
Li, H. et al. Processing of individual items during ensemble coding of facial expressions. Front. Psychol. 7, 1332 (2016).
Leib, A. Y., Kosovicheva, A. & Whitney, D. Fast ensemble representations for abstract visual impressions. Nat. Commun. 7, 13186 (2016).
Whitney, D., Haberman, J. & Sweeny, T. D. From textures to crowds: Multiple levels of summary statistical perception. In The New Visual Neurosciences 695–710 (MIT Press, Cambridge, 2014).
Marchant, A. P., Simons, D. J. & De Fockert, J. W. Ensemble representations: Effects of set size and item heterogeneity on average size perception. Acta Physiol. (Oxf) 142, 245–250 (2013).
Utochkin, I. S. & Tiurina, N. A. Parallel averaging of size is possible but range-limited: A reply to Marchant, Simons, and De Fockert. Acta Physiol. (Oxf) 146, 7–18 (2014).
Tong, K., Ji, L., Chen, W. & Fu, X. Unstable mean context causes sensitivity loss and biased estimation of variability. J. Vis. 15, 15 (2015).
Moritz, S. et al. A two-stage cognitive theory of the positive symptoms of psychosis. Highlighting the role of lowered decision thresholds. J. Behav. Ther. Exp. Psychiatry 56, 12–20 (2017).
Silverstein, S. M. & Keane, B. P. Perceptual organization impairment in schizophrenia and associated brain mechanisms: Review of research from 2005 to 2010. Schizophr. Bull. 37, 690–699 (2011).
Linscott, R. J. & Van Os, J. Systematic reviews of categorical versus continuum models in psychosis: Evidence for discontinuous subpopulations underlying a psychometric continuum implications for DSM-V, DSM-VI, and DSM-VII. Annu. Rev. Clin. Psychol. 6, 391–419 (2010).
McGrath, J. J. et al. Psychotic experiences in the general population: A cross-national analysis based on 31 261 respondents from 18 countries. JAMA Psychiatry 72, 697 (2015).
Kelleher, I. & Cannon, M. Psychotic-like experiences in the general population: characterizing a high-risk group for psychosis. Psychol. Med. 41, 1–6 (2011).
Van Os, J., Linscott, R. J., Myin-Germeys, I., Delespaul, P. & Krabbendam, L. A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness–persistence–impairment model of psychotic disorder. Psychol. Med. 39, 179–195 (2009).
Linscott, R. J. & Van Os, J. An updated and conservative systematic review and meta-analysis of epidemiological evidence on psychotic experiences in children and adults: On the pathway from proneness to persistence to dimensional expression across mental disorders. Psychol. Med. 43, 1133–1149 (2013).
Kaymaz, N. et al. Do subthreshold psychotic experiences predict clinical outcomes in unselected non-help-seeking population-based samples? A systematic review and meta-analysis, enriched with new results. Psychol. Med. 42, 2239–2253 (2012).
Green, M. F., Horan, W. P. & Lee, J. Social cognition in schizophrenia. Nat. Rev. Neurosci. 16, 620–631 (2015).
Van Donkersgoed, R. J. M., Wunderink, L., Nieboer, R., Aleman, A. & Pijnenborg, G. H. M. Social cognition in individuals at ultra-high risk for psychosis: A meta-analysis. PLoS ONE 10, e0141075 (2015).
Yiltiz, H. & Chen, L. Emotional cues and social anxiety resolve ambiguous perception of biological motion. Exp. Brain Res. 236, 1409–1420 (2018).
Peng, S., Liu, C. H., Liu, W. & Yang, Z. Emotion matters: Face ensemble perception is affected by emotional states. Psychon. Bull. Rev. 29, 116–122 (2022).
Holt-Lunstad, J. Why social relationships are important for physical health: A systems approach to understanding and modifying risk and protection. Annu. Rev. Psychol. 69, 437–458 (2018).
Birrell, L., Werner-Seidler, A., Davidson, L., Andrews, J. L. & Slade, T. Social connection as a key target for youth mental health. Ment. Health Prev. 37, 200395 (2025).
Holt-Lunstad, J. The major health implications of social connection. Curr. Dir. Psychol. Sci. 30, 251–259 (2021).
R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. (2022).
Rosseel, Y. lavaan: An R package for structural equation modeling. J. Stat. Softw. 48, 1–36 (2012).
Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M. & Rosseel, Y. semTools: Useful tools for structural equation modeling. (2025).
Bates, D., Mächler, M., Bolker, B. & Walker, S. Fitting linear mixed-effects models using lme4. J. Stat. Soft. 67, 1–48 (2015).
Revelle, W. psych: Procedures for Psychological, Psychometric, and Personality Research (Northwester University, 2025).
Kassambara, A. rstatix: Pipe-friendly framework for basic statistical tests. (2023).
Mair, P. & Wilcox, R. Robust statistical methods in R using the WRS2 package. Behav. Res. 52, 464–488 (2020).
Ben-Shachar, M., Lüdecke, D. & Makowski, D. effectsize: Estimation of effect size indices and standardized parameters. JOSS 5, 2815 (2020).
Freeman, D. et al. The revised Green et al., Paranoid Thoughts Scale (R-GPTS): Psychometric properties, severity ranges, and clinical cut-offs. Psychol. Med. 51, 244–253 (2021).
Preti, A. et al. The psychometric discriminative properties of the Peters et al Delusions Inventory: A receiver operating characteristic curve analysis. Compr. Psychiatry 48, 62–69 (2007).
Ji, L. & Pourtois, G. Capacity limitations to extract the mean emotion from multiple facial expressions depend on emotion variance. Vis. Res. 145, 39–48 (2018).
Tottenham, N. et al. The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Res. 168, 242–249 (2009).
Freeman, D. et al. The revised Green et al., Paranoid Thoughts Scale (R-GPTS): Psychometric properties, severity ranges, and clinical cut-offs. Psychol. Med. 51, 244–253 (2021).
Peters, E., Joseph, S., Day, S. & Garety, P. Measuring delusional ideation: The 21-item Peters et al. delusions inventory (PDI). Schizophr. Bull. 30, 1005–1022 (2004).
Bell, V., Halligan, P. W. & Ellis, H. D. The Cardiff Anomalous Perceptions Scale (CAPS): A new validated measure of anomalous perceptual experience. Schizophr. Bull. 32, 366–377 (2006).
Russell, D., Peplau, L. A. & Cutrona, C. E. The revised UCLA Loneliness Scale: Concurrent and discriminant validity evidence. J. Pers. Soc. Psychol. 39, 472–480 (1980).
Zimet, G. D., Dahlem, N. W., Zimet, S. G. & Farley, G. K. The multidimensional scale of perceived social support. J. Pers. Assess. 52, 30–41 (1988).
Kaufman, V. A., Perez, J. C., Reise, S. P., Bradbury, T. N. & Karney, B. R. Friendship Network Satisfaction: A multifaceted construct scored as a unidimensional scale. J. Soc. Pers. Relat. 39, 325–346 (2022).
Tran, T. et al. Increased face perception in individuals at clinical high-risk for psychosis: Mechanisms, sex differences, and clinical correlates. Schizophrenia 11, 74 (2025).
Silverstein, S. M. et al. Increased face detection responses on the mooney faces test in people at clinical high risk for psychosis. npj Schizophr 7, 26 (2021).
Parnas, J. et al. Visual binding abilities in the initial and advanced stages of schizophrenia. Acta Psychiatr. Scand. 103, 171–180 (2001).
Intraub, H. Rapid conceptual identification of sequentially presented pictures. J. Exp. Psychol. Hum. Percept. Perform. 7, 604–610 (1981).
Potter, M. C. Meaning in visual search. Science 187, 965–966 (1975).
Thorpe, S., Fize, D. & Marlot, C. Speed of processing in the human visual system. Nature 381, 520–522 (1996).
Cohen, M. A., Dennett, D. C. & Kanwisher, N. What is the bandwidth of perceptual experience?. Trends Cogn. Sci. 20, 324–335 (2016).
Linsker, R. Self-organization in a perceptual network. Computer 21, 105–117 (1988).
Kapur, S. Psychosis as a state of aberrant salience: A framework linking biology, phenomenology, and pharmacology in schizophrenia. AJP 160, 13–23 (2003).
Howes, O. D., Hird, E. J., Adams, R. A., Corlett, P. R. & McGuire, P. Aberrant salience, information processing, and dopaminergic signaling in people at clinical high risk for psychosis. Biol. Psychiat. 88, 304–314 (2020).
Howes, O. D. & Nour, M. M. Dopamine and the aberrant salience hypothesis of schizophrenia. World Psychiatry 15, 3–4 (2016).
Broyd, A., Balzan, R. P., Woodward, T. S. & Allen, P. Dopamine, cognitive biases and assessment of certainty: A neurocognitive model of delusions. Clin. Psychol. Rev. 54, 96–106 (2017).
Haxby, J. V., Hoffman, E. A. & Gobbini, M. I. The distributed human neural system for face perception. Trends Cogn. Sci. 4, 223–233 (2000).
Palermo, R. & Rhodes, G. Are you always on my mind? A review of how face perception and attention interact. Neuropsychologia 45, 75–92 (2007).
Young, A. W. & Burton, A. M. Are we face experts?. Trends Cogn. Sci. 22, 100–110 (2018).
Gupta, A. et al. Colour vision defects in schizophrenia spectrum disorders: A systematic review. Neurosci. Appl. 3, 104046 (2024).
Badre, D. Cognitive control. Annu. Rev. Psychol. 76, 167–195 (2025).
Miller, E. K. & Cohen, J. D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167–202 (2001).
Norman, D. A. & Shallice, T. Attention to action. In Consciousness and Self-Regulation: Advances in Research and Theory Vol. 4 (eds Davidson, R. J. et al.) 1–18 (Springer, Boston, 1986). https://doi.org/10.1007/978-1-4757-0629-1_1.
Uhlhaas, P. J. & Silverstein, S. M. Perceptual organization in schizophrenia spectrum disorders: Empirical research and theoretical implications. Psychol. Bull. 131, 618–632 (2005).
Silverstein, S. M. Visual perception disturbances in schizophrenia: A unified model. In The Neuropsychopathology of Schizophrenia Vol. 63 (eds Li, M. & Spaulding, W. D.) 77–132 (Springer, Cham, 2016).
Silverstein, S. M. et al. Optimization and validation of a visual integration test for schizophrenia research. Schizophr. Bull. 38, 125–134 (2012).
Gilboa-Schechtman, E., Presburger, G., Marom, S. & Hermesh, H. The effects of social anxiety and depression on the evaluation of facial crowds. Behav. Res. Ther. 43, 467–474 (2005).
Yang, J.-W., Yoon, K. L., Chong, S. C. & Oh, K. J. Accurate but pathological: Social anxiety and ensemble coding of emotion. Cogn. Ther. Res. 37, 572–578 (2013).
Acknowledgements
We thank the following individuals for assistance with data collection: Ace Chou, Ashnaa Kukkal, Ava Fahey, Brian Taliano, Enru Wang, Jaewon Jun, Kelly Nguyen, Matea Bardhi, Maya Kewalramani, Melissa Landsman, Sammy Carstens, Yuhan Shi. We thank Luyan Ji for sharing the face stimuli. We would also like to thank Emmett M. Larsen and co-authors of Larsen et al.8 for making their code and data openly available, which facilitated our effort to reproduce their analytic approach, and whose work inspired the current investigation.
Author information
Authors and Affiliations
Contributions
Katie Gibbs: Conceptualization, methodology, formal analysis, investigation, data curation, writing—original draft, project administration. Xiaoyu Dong: Methodology, software, project administration, writing—review and editing. Yunsu Shin: Investigation, project administration, writing—review and editing. Steven M. Silverstein: Conceptualization, writing—review and editing. David Dodell-Feder: Conceptualization, methodology, formal analysis, resources, writing—review and editing, supervision.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Gibbs, K., Dong, X., Shin, Y. et al. Robust averaging of emotional faces and its association with psychotic-like experiences and social connection. Sci Rep (2026). https://doi.org/10.1038/s41598-026-35374-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-026-35374-z
