Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Article
  • Published:

Evidence for the representation of non-hierarchical structures in language

Abstract

A long-standing assumption in the language sciences is that the mental representation of language is based on constituents—that is, hierarchical structures rooted in grammar. We provide evidence from English for a more basic kind of linguistic representation involving smaller, linear chunks of structure akin to sequences of parts-of-speech elements—such as verb preposition determiner shared between the strings added to a and defined by the. Across four preregistered phrasal decision experiments (total N = 497), we show that it is possible to prime such linear structures, even in the absence of constituents. In two additional corpus analyses of eye-tracked reading (N = 68) and conversation (N = 358), we establish the external validity of the effect. These results provide evidence of multiword language structures that are not explainable in terms of constituents as traditionally construed. This poses a challenge for accounts of linguistic representation, including generative and constructionist approaches.

This is a preview of subscription content, access via your institution

Access options

Buy this article

USD 39.95

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Different representations of grammatical structure.
Fig. 2: Experimental design.
Fig. 3: Structural priming in the phrasal decision task.
Fig. 4: Priming between ‘parts’ and ‘wholes’.
Fig. 5: Structural priming in eye-tracked reading.
Fig. 6: Structural priming in conversation.
Fig. 7: A possible function for non-constituent structures.

Similar content being viewed by others

Data availability

The data and materials are available via OSF at https://osf.io/ymndq/. The Corpus of Contemporary American English is available online (https://www.english-corpora.org/coca/). The CELER corpus is shared by the curators on GitHub (https://github.com/berzak/celer) but requires access to the Penn Treebank-2 (LDC95T7; https://catalog.ldc.upenn.edu/LDC95T7) and the BLLIP corpus (LDC2000T43; https://catalog.ldc.upenn.edu/LDC2000T43) from the Linguistics Data Consortium. The Switchboard corpus is available from the Linguistics Data Consortium (LDC2009T26; https://catalog.ldc.upenn.edu/LDC2009T26).

Code availability

The code is available via OSF at https://osf.io/ymndq/.

References

  1. Humboldt, W. V. On Language: On the Diversity of Human Language Construction and Its Influence on the Mental Development of the Human Species (Cambridge Univ. Press, 1999).

  2. Pinker, S. Words and Rules: The Ingredients of Language (Basic Books, 1999).

  3. Ullman, M. T. A neurocognitive perspective on language: the declarative/procedural model. Nat. Rev. Neurosci. 2, 717–726 (2001).

    Article  CAS  PubMed  Google Scholar 

  4. Ullman, M. T. Contributions of memory circuits to language: the declarative/procedural model. Cognition 92, 231–270 (2004).

    Article  PubMed  Google Scholar 

  5. Chomsky, N. The Minimalist Program (MIT Press, 1995).

  6. Croft, W. Radical Construction Grammar: Syntactic Theory in Typological Perspective 1st edn (Oxford Univ. Press, 2001).

  7. Goldberg, A. Constructions at Work: The Nature of Generalization in Language 1st edn (Oxford Univ. Press, 2005).

  8. Goldberg, A. E. Explain Me This: Creativity, Competition, and the Partial Productivity of Constructions (Princeton Univ. Press, 2019).

  9. Tomasello, M. Constructing a Language: A Usage-Based Theory of Language Acquisition (Harvard Univ. Press, 2003).

  10. Goldberg, A. E. Constructions: a new theoretical approach to language. Trends Cogn. Sci. 7, 219–224 (2003).

    Article  PubMed  Google Scholar 

  11. Johnson, M. A. & Goldberg, A. E. Evidence for automatic accessing of constructional meaning: Jabberwocky sentences prime associated verbs. Lang. Cogn. Process. 28, 1439–1452 (2013).

    Article  Google Scholar 

  12. Jackendoff, R. The Architecture of the Language Faculty (MIT Press, 1997).

  13. Nelson, R. How ‘chunky’ is language? Some estimates based on Sinclair’s idiom principle. Corpora 13, 431–460 (2018).

    Article  Google Scholar 

  14. Arnon, I. & Snider, N. More than words: frequency effects for multi-word phrases. J. Mem. Lang. 62, 67–82 (2010).

    Article  Google Scholar 

  15. Snider, N. & Arnon, I. in Frequency Effects in Language Representation (eds Divjak, D. & Gries, S. T.) 127–164 (De Gruyter Mouton, 2012).

  16. Tremblay, A., Derwing, B., Libben, G. & Westbury, C. Processing advantages of lexical bundles: evidence from self-paced reading and sentence recall tasks. Lang. Learn. 61, 569–613 (2011).

    Article  Google Scholar 

  17. Carrol, G. & Conklin, K. Is all formulaic language created equal? Unpacking the processing advantage for different types of formulaic sequences. Lang. Speech 63, 95–122 (2020).

    Article  PubMed  Google Scholar 

  18. Tremblay, A. & Baayen, H. in Perspectives on Formulaic Language: Acquisition and Communication (ed. Wood, D. C.) 151–173 (Continuum, 2010).

  19. Janssen, N. & Barber, H. A. Phrase frequency effects in language production. PLoS ONE 7, e33202 (2012).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Arnon, I. & Cohen Priva, U. More than words: the effect of multi-word frequency and constituency on phonetic duration. Lang. Speech 56, 349–371 (2013).

    Article  PubMed  Google Scholar 

  21. Arnon, I. & Clark, E. V. Why brush your teeth is better than teeth—children’s word production is facilitated in familiar sentence-frames. Lang. Learn. Dev. 7, 107–129 (2011).

    Article  Google Scholar 

  22. Bannard, C. & Matthews, D. Stored word sequences in language learning: the effect of familiarity on children’s repetition of four-word combinations. Psychol. Sci. 19, 241–248 (2008).

    Article  PubMed  Google Scholar 

  23. McCauley, S. M. et al. Multiword units lead to errors of commission in children’s spontaneous production: “what corpus data can tell us?*”. Dev. Sci. 24, e13125 (2021).

    Article  PubMed  PubMed Central  Google Scholar 

  24. Konopka, A. E. & Bock, K. Lexical or syntactic control of sentence formulation? Structural generalizations from idiom production. Cogn. Psychol. 58, 68–101 (2009).

    Article  PubMed  Google Scholar 

  25. Tucker, G. H. in Functional Descriptions: Theory in Practice Vol. 121 (eds Hasan, R. et al.) 145–178 (John Benjamins, 1996).

  26. Contreras Kallens, P. & Christiansen, M. H. Models of language and multiword expressions. Front. Artif. Intell. 5, 781962 (2022).

    Article  PubMed  PubMed Central  Google Scholar 

  27. Culicover, P. W., Jackendoff, R. & Audring, J. Multiword constructions in the grammar. Top. Cogn. Sci. 9, 552–568 (2017).

    Article  PubMed  Google Scholar 

  28. Krauska, A. & Lau, E. Moving away from lexicalism in psycho- and neuro-linguistics. Front. Lang. Sci. 2, 1125127 (2023).

    Article  Google Scholar 

  29. Wray, A. What do we (think we) know about formulaic language? An evaluation of the current state of play. Annu. Rev. Appl. Linguist. 32, 231–254 (2012).

    Article  Google Scholar 

  30. Nesi, H. & Basturkmen, H. Lexical bundles and discourse signalling in academic lectures. Int. J. Corpus Linguist. 11, 283–304 (2006).

    Article  Google Scholar 

  31. McCauley, S. M. & Christiansen, M. H. Language learning as language use: a cross-linguistic model of child language development. Psychol. Rev. 126, 1–51 (2019).

    Article  PubMed  Google Scholar 

  32. Abbot-Smith, K. & Tomasello, M. Exemplar-learning and schematization in a usage-based account of syntactic acquisition. Linguist. Rev. https://doi.org/10.1515/TLR.2006.011 (2006).

  33. Dell, G. S. & Ferreira, V. S. Thirty years of structural priming: an introduction to the special issue. J. Mem. Lang. 91, 1–4 (2016).

    Article  Google Scholar 

  34. Mahowald, K., James, A., Futrell, R. & Gibson, E. A meta-analysis of syntactic priming in language production. J. Mem. Lang. 91, 5–27 (2016).

    Article  Google Scholar 

  35. Pickering, M. J. & Ferreira, V. S. Structural priming: a critical review. Psychol. Bull. 134, 427–459 (2008).

    Article  PubMed  PubMed Central  Google Scholar 

  36. Tooley, K. M. & Traxler, M. J. Syntactic priming effects in comprehension: a critical review. Lang. Linguist. Compass 4, 925–937 (2010).

    Article  Google Scholar 

  37. Branigan, H. P. & Pickering, M. J. An experimental approach to linguistic representation. Behav. Brain Sci. 40, e282 (2017).

    Article  PubMed  Google Scholar 

  38. Bock, J. K. Syntactic persistence in language production. Cogn. Psychol. 18, 355–387 (1986).

    Article  Google Scholar 

  39. Bock, K. Closed-class immanence in sentence production. Cognition 31, 163–186 (1989).

    Article  CAS  PubMed  Google Scholar 

  40. Bock, K., Loebell, H. & Morey, R. From conceptual roles to structural relations: bridging the syntactic cleft. Psychol. Rev. 99, 150–171 (1992).

    Article  CAS  PubMed  Google Scholar 

  41. Bock, K. & Loebell, H. Framing sentences. Cognition 35, 1–39 (1990).

    Article  CAS  PubMed  Google Scholar 

  42. Bunger, A., Papafragou, A. & Trueswell, J. C. Event structure influences language production: evidence from structural priming in motion event description. J. Mem. Lang. 69, 299–323 (2013).

    Article  PubMed  PubMed Central  Google Scholar 

  43. Chang, F., Bock, K. & Goldberg, A. E. Can thematic roles leave traces of their places?. Cognition 90, 29–49 (2003).

    Article  PubMed  Google Scholar 

  44. Hare, M. L. & Goldberg, A. E. in Proc. 21st Annual Conference of the Cognitive Science Society (eds Hahn, M. & Stones, S. C.) 208–211 (Cognitive Science Society, 1999).

  45. Ungerer, T. Using structural priming to test links between constructions: English caused-motion and resultative sentences inhibit each other. Cogn. Linguist. 32, 389–420 (2021).

    Article  Google Scholar 

  46. Vernice, M., Pickering, M. J. & Hartsuiker, R. J. Thematic emphasis in language production. Lang. Cogn. Process. 27, 631–664 (2012).

    Article  Google Scholar 

  47. Ziegler, J., Snedeker, J. & Wittenberg, E. Event structures drive semantic structural priming, not thematic roles: evidence from idioms and light verbs. Cogn. Sci. 42, 2918–2949 (2018).

    Article  PubMed  Google Scholar 

  48. Ziegler, J. & Snedeker, J. How broad are thematic roles? Evidence from structural priming. Cognition 179, 221–240 (2018).

    Article  PubMed  Google Scholar 

  49. Chang, F., Dell, G. S. & Bock, K. Becoming syntactic. Psychol. Rev. 113, 234–272 (2006).

    Article  PubMed  Google Scholar 

  50. Jumelet, J., Zuidema, W. & Sinclair, A. in Findings of the Association for Computational Linguistics: ACL 2024 (eds Ku, L.-W. et al.) 14727–14742 (Association for Computational Linguistics, 2024).

  51. Sinclair, A., Jumelet, J., Zuidema, W. & Fernández, R. Structural persistence in language models: priming as a window into abstract language representations. Trans. Assoc. Comput. Linguist. 10, 1031–1050 (2022).

    Article  Google Scholar 

  52. Contreras Kallens, P., Kristensen-McLachlan, R. D. & Christiansen, M. H. Large language models demonstrate the potential of statistical learning in language. Cogn. Sci. 47, e13256 (2023).

    Article  PubMed  Google Scholar 

  53. Reitter, D. & Keller, F. in Proc. 29th Annual Conference of the Cognitive Science Society (eds McNamara, D. S. & Trafton, J. G.) 1421–1426 (Cognitive Science Society, 2007).

  54. Reitter, D., Hockenmaier, J. & Keller, F. in Proc. 2006 Conference on Empirical Methods in Natural Language Processing (eds Jurafsky, D. & Gaussier, E.) 308–316 (Association for Computational Linguistics, 2006).

  55. Pietsch, C., Buch, A., Kopp, S. & Ruiter, J. D. in Empirical Approaches to Linguistic Theory (eds Stolterfoht, B. & Featherston, S.) 29–42 (De Gruyter Mouton, 2012).

  56. Jolsvai, H., McCauley, S. M. & Christiansen, M. H. Meaningfulness beats frequency in multiword chunk processing. Cogn. Sci. 44, e12885 (2020).

    Article  PubMed  Google Scholar 

  57. Osborne, T. J. Tests for constituents: what they really reveal about the nature of syntactic structure. Lang. Discuss. https://doi.org/10.31885/lud.5.1.223 (2018).

  58. Gibson, E. Syntax: A Cognitive Approach (MIT Press, 2025).

  59. Steedman, M. The Syntactic Process (MIT Press, 2000).

  60. Gazdar, G., Klein, E., Pullum, G. K. & Sag, I. A. Generalized Phrase Structure Grammar. (Harvard Univ. Press, 1985).

  61. Meyer, D. E. & Schvaneveldt, R. W. Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations. J. Exp. Psychol. 90, 227–234 (1971).

    Article  CAS  PubMed  Google Scholar 

  62. Swinney, D. A. & Cutler, A. The access and processing of idiomatic expressions. J. Verbal Learn. Verbal Behav. 18, 523–534 (1979).

    Article  Google Scholar 

  63. Pickering, M. J., Branigan, H. P. & McLean, J. F. Constituent structure is formulated in one stage. J. Mem. Lang. 46, 586–605 (2002).

    Article  Google Scholar 

  64. McClelland, J. L. & Rumelhart, D. E. An interactive activation model of context effects in letter perception: I. An account of basic findings. Psychol. Rev. 88, 375–407 (1981).

    Article  Google Scholar 

  65. Davies, M. The Corpus of Contemporary American English (COCA) (2008–); https://www.english-corpora.org/coca/

  66. Luke, S. G. & Christianson, K. Limits on lexical prediction during reading. Cogn. Psychol. 88, 22–60 (2016).

    Article  PubMed  Google Scholar 

  67. Nielsen, Y. A. & Christiansen, M. H. Context, not grammar, is key to structural priming. Trends Cogn. Sci. 29, 703–714 (2025).

    Article  PubMed  Google Scholar 

  68. Berzak, Y. et al. CELER: a 365-participant corpus of eye movements in L1 and L2 English reading. Open Mind 6, 41–50 (2022).

    Article  PubMed  PubMed Central  Google Scholar 

  69. Gries, S. T. & Kootstra, G. J. Structural priming within and across languages: a corpus-based perspective. Biling. Lang. Cogn. 20, 235–250 (2017).

    Article  Google Scholar 

  70. Gries, S. T. Syntactic priming: a corpus-based approach. J. Psycholinguist. Res. 34, 365–399 (2005).

    Article  PubMed  Google Scholar 

  71. Jaeger, T. F. & Snider, N. E. Alignment as a consequence of expectation adaptation: syntactic priming is affected by the prime’s prediction error given both prior and recent experience. Cognition 127, 57–83 (2013).

    Article  PubMed  PubMed Central  Google Scholar 

  72. Tooley, K. M. Structural priming during comprehension: a pattern from many pieces. Psychon. Bull. Rev. 30, 882–896 (2023).

    Article  PubMed  Google Scholar 

  73. Godfrey, J. J., Holliman, E. C. & McDaniel, J. in Proc. 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP-92) Vol. 1, 517–520 (IEEE, 1992).

  74. Calhoun, S. et al. The NXT-format Switchboard corpus: a rich resource for investigating the syntax, semantics, pragmatics and prosody of dialogue. Lang. Res. Eval. 44, 387–419 (2010).

    Article  Google Scholar 

  75. Blasi, D. E., Henrich, J., Adamou, E., Kemmerer, D. & Majid, A. Over-reliance on English hinders cognitive science. Trends Cogn. Sci. 26, 1153–1170 (2022).

    Article  PubMed  Google Scholar 

  76. Koplenig, A., Meyer, P., Wolfer, S. & Muller-Spitzer, C. The statistical trade-off between word order and word structure—large-scale evidence for the principle of least effort. PLoS ONE 12, e0173614 (2017).

    Article  PubMed  PubMed Central  Google Scholar 

  77. Santesteban, M., Pickering, M. J., Laka, I. & Branigan, H. P. Effects of case-marking and head position on language production? Evidence from an ergative OV language. Lang. Cogn. Neurosci. 30, 1175–1186 (2015).

    Article  Google Scholar 

  78. Vasilyeva, M. & Waterfall, H. Beyond syntactic priming: evidence for activation of alternative syntactic structures. J. Child Lang. 39, 258–283 (2012).

    Article  PubMed  Google Scholar 

  79. Mercan, G. & Hohenberger, A. Structural priming in the production of Turkish possessive noun phrases and noun clauses. J. Cult. Cogn. Sci. 3, 5–24 (2019).

    Article  Google Scholar 

  80. Jackendoff, R. & Audring, J. The Texture of the Lexicon: Relational Morphology and the Parallel Architecture 1st edn (Oxford Univ. Press, 2019).

  81. Tomasello, M. The Cultural Origins of Human Cognition (Harvard Univ. Press, 1999).

  82. Lester, N. A., Feldman, L. B. & Martín, F. M. D. P. in Proc. 39th Annual Conference of the Cognitive Science Society (eds Gunzelmann, G. et al.) 2537–2542 (Cognitive Science Society, 2017).

  83. Bybee, J. & McClelland, J. L. Alternatives to the combinatorial paradigm of linguistic theory based on domain general principles of human cognition. Linguist. Rev. https://doi.org/10.1515/tlir.2005.22.2-4.381 (2005).

  84. Chater, N. & Christiansen, M. H. Language acquisition as skill learning. Curr. Opin. Behav. Sci. 21, 205–208 (2018).

    Article  Google Scholar 

  85. Ellis, N. C., Frey, E. & Jalkanen, I. in Studies in Corpus Linguistics Vol. 35 (eds Römer, U. & Schulze, R.) 89–114 (John Benjamins, 2009).

  86. Christiansen, M. H. & Chater, N. Creating Language: Integrating Evolution, Acquisition, and Processing (MIT Press, 2016).

  87. Christiansen, M. H. & Chater, N. The now-or-never bottleneck: a fundamental constraint on language. Behav. Brain Sci. 39, e62 (2016).

    Article  PubMed  Google Scholar 

  88. Sagarra, N. & Herschensohn, J. The role of proficiency and working memory in gender and number agreement processing in L1 and L2 Spanish. Lingua 120, 2022–2039 (2010).

    Article  Google Scholar 

  89. O’Grady, W. The illusion of language acquisition. Linguist. Approaches Biling. 3, 253–285 (2013).

    Article  Google Scholar 

  90. Frank, S. L., Bod, R. & Christiansen, M. H. How hierarchical is language use? Proc. R. Soc. B 279, 4522–4531 (2012).

    Article  PubMed  PubMed Central  Google Scholar 

  91. Langacker, R. W. Grammar and Conceptualization (De Gruyter Mouton, 1999).

  92. Townsend, D. J. & Bever, T. Sentence Comprehension: The Integration of Habits and Rules (MIT Press, 2001).

  93. Dąbrowska, E. & Lieven, E. Towards a lexically specific grammar of children’s question constructions. Cogn. Linguist. 16, 437–474 (2005).

    Article  Google Scholar 

  94. Nielsen, Y. A. & Christiansen, M. H. in Proc. 45th Annual Conference of the Cognitive Science Society (eds Goldwater, M. et al.) 1189–1197 (Cognitive Science Society, 2023).

  95. Rouder, J. N. Optional stopping: no problem for Bayesians. Psychon. Bull. Rev. 21, 301–308 (2014).

    Article  PubMed  Google Scholar 

  96. Bürkner, P. C. & Charpentier, E. Modelling monotonic effects of ordinal predictors in Bayesian regression models. Br. J. Math. Stat. Psychol. 73, 420–451 (2020).

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank P. C. Kallens for help with corpus mining, K. Chan and A. Chen for help with stimulus generation, F. Frinsel for help setting up the in-lab experiment, R. P. Chaves for bringing p-stranding and ellipsis to our attention, E. Westgate for access to the University of Florida participant pool, S. Pfattheicher for supporting Study 3, and R. Fusaroli for guidance on statistical analyses. Study 3 was funded by the Aarhus University Research Foundation through grant no. AUFF-E-2018-7-13 (awarded to S. Pfattheicher), and Study 4 was funded by the research programme Linguistics, Cognitive Science and Semiotics at the School of Communication and Culture, Aarhus University (awarded to Y.A.N.). The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: Y.A.N. and M.H.C. Methodology: Y.A.N. and M.H.C. Formal analysis: Y.A.N. Investigation: Y.A.N. Writing—original draft: Y.A.N. Writing—review and editing: Y.A.N. and M.H.C.

Corresponding author

Correspondence to Yngwie A. Nielsen.

Ethics declarations

Competing interests

The authors declare no competing interests.

Peer review

Peer review information

Nature Human Behaviour thanks Martina Wiltschko and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary Information (download PDF )

Supplementary Methods, Results (Supplementary Table 1 and Fig. 1) and Discussion (Supplementary Fig. 2).

Reporting Summary (download PDF )

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nielsen, Y.A., Christiansen, M.H. Evidence for the representation of non-hierarchical structures in language. Nat Hum Behav 10, 579–588 (2026). https://doi.org/10.1038/s41562-025-02387-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Version of record:

  • Issue date:

  • DOI: https://doi.org/10.1038/s41562-025-02387-z

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing