Research
Scientific studies of human communication
Humans effortlessly share their immediate thoughts with other human minds, but it remains a mystery how. A common language certainly helps but we know that it is not necessary for communication, as we also understand tourists and infants who speak a different language or no language at all. In fact, research shows we can instantly build new ways to communicate if we need to, but how we achieve this extraordinary feat is largely an open question. Our understanding may be limited because the open-ended and interpersonal nature of human communication has been largely overlooked or simply out of reach of controlled scientific experiments. The below snapshots and suggested readings represent a selection of studies that have taken up this challenge. This list is not exhaustive but meant to provide a glimpse of the history and status quo of this inter-disciplinary research theme at the roots of human sociality. The list also includes recent neuroscientific and clinical observations on (experimentally-controlled) communicative interaction. Together, this work is suggesting that people in dialogue understand one another because they continuously develop and coordinate a shared cognitive space that provides critical context for using and interpreting communicative messages (Stolk, Verhagen & Toni, 2016). Our international team aims to understand how this fleeting knowledge space is generated in our brains, and how its representation is altered in disorders of human communication.
Autistic individuals struggle to rapidly converge on a shared meaning for an utterance when meaning requires referencing the shared communicative context
This study causally tested the notion of a shared cognitive space underlying human communication in pairs of individuals on the autism spectrum (Wadge et al., Cortex 2019). Despite otherwise indistinguishable performance from neurotypical pairs, pairs containing autistic individuals had lower communicative success. This communicative impairment was predicted by their ability to rapidly align on the meaning of an utterance with their communication partners. This misalignment was greatest when meaning depended on the unique communicative context established through past interaction with their partners.
Brains become synchronized due to the accumulation of shared representations at a scale independent from individual utterances
Using two scanners, this neuroimaging study found that brain areas tracking mutual understanding over a series of interactions become synchronized due to the accumulation of shared representations (Stolk et al., PNAS 2014). This interpersonal synchrony occurred only when the pairs developed new shared representations, and at a temporal scale independent from individual communicative utterances. This observation suggests that the meaning of an utterance is not a property of the utterance itself. Rather, people in dialogue understand one another because they continuously keep their thoughts aligned with one another, forming a shared cognitive space that provides critical context for selecting and interpreting utterances.
Communicators and addressees achieve mutual understanding by using the same computational procedures and neuronal substrates
Using magnetoencephalography, this study found that the same right-hemisphere brain regions in communicators and addressees are already upregulated before a communicative utterance is generated or interpreted during social interaction (Stolk et al., PNAS 2013).
Interpreting indirectness engages overlapping brain networks across overhearers and addressees
Using a fictional job interview setting in the scanner, this study found that interpreting indirect, non-literal answers from interviewees activated brain regions inside as well as outside the language-dominant left hemisphere, including the right hemisphere and medial prefrontal structures, both when those answers were directed to them or to other interviewers (Bašnáková et al., 2015).
Children who spent an increased number of days in daycare may benefit from a greater exposure to social and communicative situations
The style in which five-year-olds tried to communicate changed depending on who the children thought their co-player was. When they thought they were playing with a two-year-old, they spent a great deal of time trying to patiently convey relevant game information. When they were told they were playing with a child their own age, their communication style was not as labored. The more days children spent in daycare, the more they adjusted their communication style, suggesting an important role for early social experience in the development of our interactional abilities (Stolk et al., PLoS One 2013).
Language processing depends on local principles of interaction
This study had pairs of adults describe locations within a predefined spatial network to help each other reach target locations. They could talk back and forth as much as they needed. The main findings are that, in referring to locations, different pairs converge on different descriptions for the same location. However, within the same pair, speakers adopt very similar forms of descriptions, a processed dubbed lexical entrainment. This entrainment is progressive, increasing as the dialogue proceeds, suggesting that dialogue partners coordinate to achieve a singl mutually satisfactory type of description (Garrod & Anderson, Cognition 1987).
Referring as a collaborative process between speakers and listeners
This study had pairs of adults describe figures based on the ancient Chinese game of Tangram in order to achieve a target arrangement of those figures. They could talk back and forth as much as they needed. The study found that when speakers refer to an object, they are proposing a conceptualization of it, a proposal their addressees may or may not agree to. Once they do establish a shared conceptualization, dubbed a conceptual pact, they appeal to it in later references even when they could use simpler references. Over time, speakers simplify conceptual pacts and, when necessary, abandon them for new conceptualizations (Clark & Wilkes-Gibbs, Cognition 1986).
Communicative proficiency improves from kindergarten age onward
This study had pairs of children in kindergarten, 1st, 3rd and 5th grades play a communication game which required they develop names to refer to unique graphic figures, portrayed on a wooden block with a hole in it. They would receive these blocks one at a time from a dispenser. Then they described the figure to the listener, someone their own age, who then needed to infer and select the intended figure and block. After each description, both players stacked their blocks on a peg, and after each round the pegs were compared for overlap. Unlike older children, kindergartners did not improve their communication across interactions with the same partner, suggesting that age 5 represents a critical milestone in the development of our interactional abilities (Krauss & Glucksberg, Child Development 1969).
Suggested readings
Stolk A, Basnakova J, Toni I (2022). Joint epistemic engineering: The neglected process in human communication. in The Routledge Handbook of Semiosis and the Brain
Toni I, Stolk A (2019). Conceptual alignment as a neurocognitive mechanism for human communicative interactions. in Human Language: from Genes and Brains to Behavior, MIT Press
Wheatley T, Boncz A, Toni I, Stolk A (2019). Beyond the isolated brain: The promise and challenge of interacting minds. Neuron 103 (2), 186-188
Wadge H, Brewer R, Bird G, Toni I, Stolk A (2019). Communicative misalignment in Autism Spectrum Disorder. Cortex 115, 15-26
Kuhlen AK, Bogler C, Brennan SE, Haynes JD (2017). Brains in dialogue: decoding neural preparation of speaking to a conversational partner. Social Cognitive and Affective Neuroscience, 871–880
de Boer M, Kokal I, Blokpoel M, Liu R, Stolk A, Roelofs K, van Rooij I, Toni I (2017). Oxytocin modulates human communication by enhancing cognitive exploration. Psychoneuroendocrinology
Oosterwijk AM, de Boer M, Stolk A, Hartmann F, Toni I, Verhagen L (2017). Communicative knowledge pervasively influences sensorimotor computations. Scientific Reports
Ye Z, Stolk A, Toni I, Hagoort P (2016). Oxytocin modulates semantic integration in speech comprehension. J Cogn Neurosci
Stolk A, Verhagen L, Toni I (2016). Conceptual alignment: How brains achieve mutual understanding. Trends in Cognitive Sciences 20 (3), 180-191
Stolk A, Blokpoel M, van Rooij I, Toni I (2015). On the generation of shared symbols. in Cognitive Neuroscience of Natural Language Use, Cambridge University Press
Stolk A, D'Imperio D, di Pellegrino G, Toni I (2015). Altered communicative decisions following ventromedial prefrontal lesions. Current Biology 25 (11), 1469-1474
Basnakova J, van Berkum J, Weber K, Hagoort P (2015). A job interview in the MRI scanner: How does indirectness affect addressees and overhearers? Neuropsychologia 76, 79-91
Stolk A (2014). On the generation of shared symbols. Donders Series
Stolk A, Noordzij ML, Verhagen L, Volman I, Schoffelen J-M, Oostenveld R, Hagoort P, Toni I (2014). Cerebral coherence between communicators marks the emergence of meaning. Proceedings of the National Academy of Sciences 111 (51), 18183-18188
Stolk A (2014). In sync: Metaphor, mechanism or marker of mutual understanding? Journal of Neuroscience 34 (16), 5397-5398
Stolk A, Noordzij ML, Volman I, Verhagen L, Overeem S, van Elswijk G, Bloem B, Hagoort P, Toni I (2014). Understanding communicative actions: A repetitive TMS study. Cortex 51, 25-34
Basnakova J, Weber K, Petersson KP, van Berkum, Hagoort P (2014). Beyond the language given: The neural correlates of inferring speaker meaning. Cerebral Cortex, 24(10), 2572–2578
Stolk A, Verhagen L, Schoffelen J-M, Oostenveld R, Blokpoel M, Hagoort P, van Rooij I, Toni I (2013). Neural mechanisms of communicative innovation. Proceedings of the National Academy of Sciences 110 (36), 14574-14579
Stolk A, Hunnius S, Bekkering H, Toni I (2013). Early social experience predicts referential communicative adjustments in five-year-old children. PLoS One 8 (8), e72667
Blokpoel M, van Kesteren M, Stolk A, Haselager P, Toni I, van Rooij I (2012). Recipient design in human communication: simple heuristics or perspective taking? Frontiers in Human Neuroscience 6, 253
Galantucci B, Garrod S (2011). Experimental semiotics: a review. Frontiers in Human Neuroscience 5, 11
Brennan SE, Galati A, Kuhlen AK (2010). Two minds, one dialog: coordinating speaking and understanding. Psychol. Learn. Motiv. 53, 301–344
Willems RM, de Boer M, de Ruiter JP, Noordzij ML, Hagoort P, Toni I (2010). A dissociation between linguistic and communicative abilities in the human brain. Psychol. Sci. 21, 8–14
Noordzij ML, Newman-Norlund SE, de Ruiter JP, Hagoort P, Levinson SC, Toni I (2010). Neural correlates of intentional communication. Frontiers in Neuroscience 4, 188
Willems RM, Varley RA (2010). Neural insights into the relation between language and communication. Frontiers in Human Neuroscience 4, 203
de Ruiter JP, Noordzij ML, Newman-Norlund S, Newman-Norlund R, Hagoort P, Levinson SC, Toni I (2010). Exploring the cognitive infrastructure of communication. Interact Stud 11, 51–77
Hrdy SB (2009). Mothers and Others: The Evolutionary Origins of Mutual Understanding, Harvard University Press
Tomasello M (2008). Origins of Human Communication, MIT Press
Levinson SC (2006). On the human interactional engine. in Roots of Human Sociality (Enfield, N. and Levinson, S., eds),39–69, Berg
Carpendale JI, Lewis C (2004). Constructing an understanding of mind: the development of children's social understanding within social interaction. Behav. Brain Sci. 27, 79–96
Clark HH (1996). Using Language, Cambridge University Press
Brennan SE, Clark HH (1996). Conceptual pacts and lexical choice in conversation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22(6), 1482–1493
Garrod S, Anderson A (1987). Saying what you mean in dialogue: A study in conceptual and semantic co-ordination. Cognition, 27(2), 181–218
Clark HH, Wilkes-Gibbs D (1986). Referring as a collaborative process. Cognition 22, 1-39
Krauss RM, Gluckberg S (1969). The development of communicaion: competence as a function of age. Child Development, 40(1), 255-266
Media articles
The power of early diversity, Psychology Today
Childhood social interactions can combat stereotypes, Dartmouth News
How stereotypes impact our social interactions, Psychology Today
The hidden act in everyday conversation, Psychology Today
Why don't we say what we really mean?, Het Talige Brein
Wat grote pupillen te maken hebben met een vlotte babbel, De Standaard
Hoe we elkaar begrijpen - of soms juist niet, Kennislink
A computer game provides invaluable information on autism spectrum disorder, CORDIS
How we understand each other in a shared cognitive space, Donders Newsletter
A novel cause for communication deficits in autism, Language In Interaction
Will computers ever truly understand what we’re saying?, UC Berkeley
Will computers ever understand us?, Donders Institute
Waarom zijn computers zo slecht in communiceren met mensen?, Motherboard
Waarom je computer je niet begrijpt, Kennislink
Frontal lobe damage alters communication, Donders Institute
Communicatie mist nuance bij frontale hersenschade, Radboud University
Synchrony in communicating brains, Donders Institute
Honden luisteren net als mensen, Volkskrant
De “Just-Yo” app en wederzijds begrip, Donders Wonders
Elkaar begrijpen gaat niet alleen met woorden, Kennislink
Begrijpen kan ook zonder taal, Volkskrant
A rough guide to mind-reading, The Guardian
Creche maakt kinderen socialer, Volkskrant
Creche versterkt inlevingsvermogen, Kennislink
Children who go to daycare may benefit from a wider variety of social situations, ScienceDaily
Non-verbale communicatie, Het Talige Brein