Research graph
References from Prior expectations guide multisensory integration during face-to-face communication. Local targets link to admitted publications; unresolved targets remain external evidence.
The origin of human multi-modal communication
10.1098/rstb.2013.0302 · 2014 · External reference
Language as a multimodal phenomenon: implications for language learning, processing and evolution
10.1098/rstb.2013.0292 · 2014 · External reference
Why We Should Study Multimodal Language
10.3389/fpsyg.2018.01109 · 2018 · External reference
Multimodal Language Processing in Human Communication
10.1016/j.tics.2019.05.006 · 2019 · External reference
Multimodal processing in face-to-face interactions: A bridging link between psycholinguistics and sensory neuroscience
10.3389/fnhum.2023.1108354 · 2023 · External reference
Visual bodily signals as core devices for coordinating minds in interaction
10.1098/rstb.2021.0094 · 2022 · External reference
10.1017/cbo9780511635649
10.1017/cbo9780511635649 · 2009 · External reference
Feeling addressed! The role of body orientation and co-speech gesture in social communication
10.1002/hbm.22746 · 2015 · External reference
Eye Direction Detection and Perception as Premises of a Social Brain: A Narrative Review of Behavioral and Neural Data
10.3758/s13415-021-00959-w · 2022 · External reference
The role of synchrony and ambiguity in speech-gesture integration during comprehension
10.1162/jocn.2010.21462 · 2011 · External reference
Turn-taking in Human Communication--Origins and Implications for Language Processing
10.1016/j.tics.2015.10.010 · 2016 · External reference
Processing language in face-to-face conversation: Questions with gestures get faster responses
10.3758/s13423-017-1363-z · 2018 · External reference
The multimodal facilitation effect in human communication
10.3758/s13423-022-02178-x · 2023 · External reference
Two sides of the same coin: speech and gesture mutually interact to enhance comprehension
10.1177/0956797609357327 · 2010 · External reference
The role of iconic gestures and mouth movements in face-to-face communication
10.3758/s13423-021-02009-5 · 2022 · External reference
Understanding discourse in face-to-face settings: The impact of multimodal cues and listening conditions
10.1037/xlm0001399 · 2025 · External reference
Gestures speed up responses to questions
10.1080/23273798.2024.2314021 · 2024 · External reference
Perceptual Inference, Learning, and Attention in a Multisensory World
10.1146/annurev-neuro-100120-085519 · 2021 · External reference
Audiovisual synchrony improves motion discrimination via enhanced connectivity between early visual and auditory areas
10.1523/jneurosci.5745-09.2010 · 2010 · External reference
Causal inference of asynchronous audiovisual speech
10.3389/fpsyg.2013.00798 · 2013 · External reference
Audiovisual asynchrony detection in human speech
10.1037/a0019952 · 2011 · External reference
Temporal constraints on the McGurk effect
10.3758/bf03206811 · 1996 · External reference
Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices
10.1523/jneurosci.2252-07.2007 · 2007 · External reference
Correlation detection as a general mechanism for multisensory integration
10.1038/ncomms11543 · 2016 · External reference
When correlation implies causation in multisensory integration
10.1016/j.cub.2011.11.039 · 2012 · External reference
Temporal window of integration in auditory-visual speech perception
10.1016/j.neuropsychologia.2006.01.001 · 2007 · External reference
Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli
10.1016/s0926-6410(03)00074-0 · 2003 · External reference
Temporal and spatial dependency of the ventriloquism effect
10.1097/00001756-200101220-00009 · 2001 · External reference
Just how important is spatial coincidence to multisensory integration? Evaluating the spatial rule
10.1111/nyas.12121 · 2013 · External reference
Prior auditory information shapes visual category-selectivity in ventral occipito-temporal cortex
10.1016/j.neuroimage.2010.05.002 · 2010 · External reference
Speech cues contribute to audiovisual spatial integration
10.1371/journal.pone.0024016 · 2011 · External reference
Perceptual congruency of audio-visual speech affects ventriloquism with bilateral visual stimuli
10.3758/s13423-010-0027-z · 2011 · External reference
Physical and perceptual factors shape the neural mechanisms that integrate audiovisual signals in speech comprehension
10.1523/jneurosci.6510-10.2011 · 2011 · External reference
Perceptual decisions formed by accumulation of audiovisual evidence in prefrontal cortex
10.1523/jneurosci.0455-10.2010 · 2010 · External reference
“When birds of a feather flock together”: synesthetic correspondences modulate audiovisual integration in non-synesthetes
10.1371/journal.pone.0005664 · 2009 · External reference
Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing
10.1523/jneurosci.5437-08.2009 · 2009 · External reference
Crossmodal correspondences: a tutorial review
10.3758/s13414-010-0073-7 · 2011 · External reference
Intersensory binding across space and time: a tutorial review
10.3758/s13414-013-0475-4 · 2013 · External reference
Assessing the Role of the “Unity Assumption” on Multisensory Integration: A Review
2017 · External reference
Crossmodal Correspondences: Standing Issues and Experimental Guidelines
10.1163/22134808-00002502 · 2016 · External reference
Immediate perceptual response to intersensory discrepancy
10.1037/0033-2909.88.3.638 · 1980 · External reference
Crossmodal binding: evaluating the “unity assumption” using audiovisual speech stimuli
10.3758/bf03193776 · 2007 · External reference
Knowledge about a common source can promote visual- haptic integration
10.1068/p5851 · 2007 · External reference
How prior expectations shape multisensory perception
10.1016/j.neuroimage.2015.09.045 · 2016 · External reference
Binding and unbinding the auditory and visual streams in the McGurk effect
10.1121/1.4728187 · 2012 · External reference
A simple and efficient method to enhance audiovisual binding tendencies
10.7717/peerj.3143 · 2017 · External reference
Metacognition in Multisensory Perception
10.1016/j.tics.2016.08.006 · 2016 · External reference
Learning to integrate arbitrary signals from vision and touch
10.1167/7.5.7 · 2007 · External reference
Long-term music training tunes how the brain temporally binds signals from multiple senses
2011 · External reference
Bayesian networks, Bayesian learning and cognitive development
10.1111/j.1467-7687.2007.00584.x · 2007 · External reference
Bayesian natural selection and the evolution of perceptual systems
10.1098/rstb.2001.1055 · 2002 · External reference
Causal inference in multisensory perception
10.1371/journal.pone.0000943 · 2007 · External reference
Causal inference in perception
10.1016/j.tics.2010.07.001 · 2010 · External reference
Multisensory neural processing: from cue integration to causal inference
10.1016/j.cophys.2020.04.004 · 2020 · External reference
Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception
10.1371/journal.pcbi.1006110 · 2018 · External reference
A Causal Inference Model Explains Perception of the McGurk Effect and Other Incongruent Audiovisual Speech
10.1371/journal.pcbi.1005229 · 2017 · External reference
Sensory reliability shapes perceptual inference via two mechanisms
10.1167/15.5.22 · 2015 · External reference
Cortical hierarchies perform Bayesian causal inference in multisensory perception
10.1371/journal.pbio.1002073 · 2015 · External reference
To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference
10.1371/journal.pbio.3000210 · 2019 · External reference
Humans integrate visual and haptic information in a statistically optimal fashion
10.1038/415429a · 2002 · External reference
The ventriloquist effect results from near-optimal bimodal integration
10.1016/j.cub.2004.01.029 · 2004 · External reference
Merging the senses into a robust percept
10.1016/j.tics.2004.02.002 · 2004 · External reference
Attentional Capture and Control
10.1146/annurev-psych-011624-025340 · 2025 · External reference
Direct gaze captures visuospatial attention
10.1080/13506280444000157 · 2005 · External reference
Are social interactions preferentially attended in real-world scenes? Evidence from change blindness
10.1177/17470218231161044 · 2023 · External reference
Attentional bias towards social interactions during viewing of naturalistic scenes
10.1177/17470218221140879 · 2023 · External reference
Human body motion captures visual attention and elicits pupillary dilation
10.1016/j.cognition.2019.104029 · 2019 · External reference
Catching eyes: effects of social and nonsocial cues on attention capture
10.1177/0956797613516147 · 2014 · External reference
Visual Preference for Socially Relevant Spatial Relations in Humans and Monkeys
10.1177/09567976241242995 · 2024 · External reference
Self-related objects increase alertness and orient attention through top-down saliency
10.3758/s13414-021-02429-4 · 2022 · External reference
Social relevance modulates multisensory integration
10.1037/xhp0001013 · 2022 · External reference
Self as a prior: The malleability of Bayesian multisensory integration to social salience
10.1111/bjop.12683 · 2024 · External reference
Attention controls multisensory perception via two distinct mechanisms at different levels of the cortical hierarchy
10.1371/journal.pbio.3001465 · 2021 · External reference
Effects of degree of visual association and angle of displacement on the “ventriloquism” effect
1973 · External reference
Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses
10.3758/brm.41.4.1149 · 2009 · External reference
Unresolved reference
External reference
Virtual sound source positioning using vector base amplitude panning
1997 · External reference
Biases in Visual, Auditory, and Audiovisual Perception of Space
10.1371/journal.pcbi.1004649 · 2015 · External reference
Updating spatial hearing abilities through multisensory and motor cues
10.1016/j.cognition.2020.104409 · 2020 · External reference
Spatial hearing training in virtual reality with simulated asymmetric hearing loss
10.1038/s41598-024-51892-0 · 2024 · External reference
Probability matching as a computational strategy used in perception
10.1371/journal.pcbi.1000871 · 2010 · External reference
The neural dynamics of hierarchical Bayesian causal inference in multisensory perception
10.1038/s41467-019-09664-2 · 2019 · External reference
Computational models of multisensory integration
10.1016/b978-0-12-812492-5.00005-x · 2020 · External reference
Bayes Factors
10.1080/01621459.1995.10476572 · 1995 · External reference
Bayesian model selection for group studies
10.1016/j.neuroimage.2009.03.025 · 2009 · External reference
Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons
10.1038/nrn3503 · 2013 · External reference
Integration of audiovisual spatial signals is not consistent with maximum likelihood estimation
10.1016/j.cortex.2019.03.026 · 2019 · External reference
Neural correlates of reliability-based cue weighting during multisensory integration
10.1038/nn.2983 · 2011 · External reference
Causal Inference in the Multisensory Brain
2019 · External reference
Unresolved reference
2008 · External reference
Localization of sound in rooms, III: Onset and duration effects
10.1121/1.394282 · 1986 · External reference
Cue Integration: A Common Framework for Social Cognition and Physical Perception
10.1177/1745691613475454 · 2013 · External reference
More than words: word predictability, prosody, gesture and mouth movements in natural language comprehension
2021 · External reference
Interactionally Embedded Gestalt Principles of Multimodal Human Communication
10.1177/17456916221141422 · 2023 · External reference
Multimodal communication and language origins: integrating gestures and vocalizations
10.1111/brv.12535 · 2019 · External reference
On the human “interaction engine.”
2006 · External reference
Revisiting the human “interaction engine”: comparative approaches to social action coordination
10.1098/rstb.2021.0092 · 2022 · External reference
Electrophysiological evidence for the understanding of maternal speech by 9-month-old infants
10.1177/0956797612438734 · 2012 · External reference
Neural responses to multimodal ostensive signals in 5-month-old infants
10.1371/journal.pone.0072360 · 2013 · External reference
Eye contact detection in humans from birth
10.1073/pnas.152159999 · 2002 · External reference
10.7551/mitpress/7551.001.0001
10.7551/mitpress/7551.001.0001 · 2008 · External reference
Natural pedagogy
10.1016/j.tics.2009.01.005 · 2009 · External reference
Natural pedagogy as evolutionary adaptation
10.1098/rstb.2010.0319 · 2011 · External reference
Cross-cultural reading the mind in the eyes: an fMRI investigation
10.1162/jocn.2009.21187 · 2010 · External reference
The effect of culture on perspective taking
10.1111/j.1467-9280.2007.01946.x · 2007 · External reference
