Keynote speakers:

Henrik Ehrsson

Multisensory mechanisms of body self-perception

Department of Neuroscience, Karolinska Institutet, Sweden

[Abstract] Ask any child if his hands belong to him and the answer will be “Of course!”  But how does the brain actually identify its own body? Our hypothesis is that parts of the body are distinguished from the external world by the patterns they produce of correlated information from different sensory modalities (vision, touch and muscle sense). These correlations are hypothesized to be detected by neuronal populations in frontal and parietal areas that integrate multisensory information from the space near the body.  We have used a combination of functional magnetic resonance imaging and human behavioral experiments to present experimental evidence in support of these predictions. To change the feeling of body ownership, perceptual illusions were used where healthy individuals experienced that a rubber hand was their own, that a mannequin was their body (“body-swap illusion”), or, that they are outside their physical body and looking at it from the perspective of another individual (“out-of-body illusion”). By clarifying how the normal brain produces a sense of ownership of one’s body, we can learn to project ownership onto prosthetic devices in amputees. This will facilitate the development of advanced prosthetic limbs that feels just like real limbs.

Yongdi Zhou

Neuronal activity in the monkey brain in visual-haptic cross-modal memory

Director, NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai

Dean, School of Psychology and Cognitive Science

The long-term goal of Professor Zhou’s research is to study the neural mechanisms of perception and short-term retention of tactile information for subsequent action (tactile working memory). His present work focuses on the neurophysiology of parietal cortical areas including the primary somatosensory cortex (SI), and prefrontal cortical areas in tactile working memory and cross-modal stimulus-stimulus associations. An understanding of the neural mechanisms of tactile memory and the neurophysiology of tactile cross-modal association may clarify the functional role of cortical networks both in sensorimotor learning and deficits following cortical lesions.


Steven A. Hillyard, PhD

Auditory Influences on Visual Attention and Perception

Professor Emeritus, Department of Neurosciences, School of Medicine, UC San Diego

[Abstract] It is well established that directing attention voluntarily to an object’s location results in the multi-modal facilitation of the object’s properties.   Evidence is also mounting that salient sounds may attract attention involuntarily and facilitate the processing of visual stimuli at the sound’s location.   This cross-modal capture of visual attention may occur even when the attracting sound is irrelevant to the ongoing task and is non-predictive of subsequent events.  A slow positive component in the event-related potential (ERP) elicited by a salient sound was found to be localized to the visual cortex.  This neural sign of visual cortex activation was predictive of enhanced perceptual processing and was paralleled by a desynchronization (blocking) of the ongoing occipital alpha rhythm.  Further research is needed to determine the nature of the relationship between the slow positive ERP evoked by the sound and the alpha desynchronization and to understand how these auditory-evoked neural events contribute to improved visual-perceptual processing.




Symposia 1: 40 Years of the McGurk-MacDonald Effect

Organizer:  Michael Beauchamp, Baylor College of Medicine; Jean Vroomen, Tilburg University;Salvador Soto-Faraco, Universitat Pompeu Fabra


(1) John MacDonald, retired
Hearing Lips and seeing Voices: A look Back 40 Years
(2) Julia Irwin, Haskins Laboratories
Seeing to hear: Audiovisual speech perception as a tool for understanding special populations.
(3)Michael Beauchamp, Baylor College of Medicine
Models and Mechanisms of Multisensory Speech Perception
(4) Salvador Soto-Faraco, Universitat Pompeu Fabra
The role of attention and conflict in the McGurk-MacDonald effect
(5) Jean Vroomen, Tilburg University
Linking the McGurk-MacDonald effect to Lipreading and the Ventriloquist Effect

Symposia 2: Adaptation in space and time

Organizer:Jeff Yau, Baylor College of Medicine; Fang Jiang, University of Nevada, Reno

(1) Scinob Kuroki, NTT Communication Science Laboratories
Motion system in touch
(2)Fang Jiang, University of Nevada, Reno
Cross-modal motion processing after sight recovery
(3) Lihan Chen, Peking University         
Geometric mean of auditory intervals assimilates visual apparent motion
(4) Jeff Yau, Baylor College of Medicine
Adaptation reveals convergence of auditory and tactile frequency signals
(5) David Alais, University of Sydney
Serial dependencies in rapid stimulus sequences show evidence for attractive and repulsive adaptation over brief time-scales
(6) James Finley  University of Southern California
Modulation of Adaptive Locomotor Learning through Manipulation of Optic Flow

Symposia 3:A multisensory investigation of the functional significance of pain-related brain responses: psychophysiological implications and methodological advances

Organizer: LiHu, Institute of Psychology, Chinese Academy of Sciences, China


(1)Li Hu, Institute of Psychology, Chinese Academy of Sciences, China Painful issues in pain prediction
(2)Zhiguo Zhang, School of Data and Computer Science, Sun Yan-Sen University, China
Cross-individual pain prediction: Is it only a matter of methods?
(3)Meng Liang, School of Medical Imaging, Tianjin Medical University, China
Primary sensory cortices contain distinguishable spatial patterns of activity for each sense
(4)Jixin Liu, School of Life Science and Technology, Xidian University, China
Disrupted brain connectome and its changing tend in migraine sufferers
(5)Weiwei Peng, Faculty of Psychology, Southwest University, China
Multi-modality sensory stimuli induced time-frequency electrophysiological responses
(6)Gan Huang, School of Data and Computer Science, Sun Yan-Sen University, China
Amplitudes and latencies of single-trial LEPs estimated by a an adaptive time alignment method

Symposia 4: Cross-modal plasticity and integration in sensory restoration by invasive/non-invasive approaches (and their potential combination): from basic science to rehab

Organizer: Amir Amedi, Hebrew University of Jerusalem, Israel; Benedetta Heimlera, Hebrew University of Jerusalem, Israel

(1) Benedetta Heimlera, Hebrew University of Jerusalem, Israel
Cochlear implants (CIs) as the best model for improving sensory restoration outcomes
(2) Ye Wang, National University of Singapore
MOPPET: a novel auditory training platform to teach music to children with cochlear implants
(3) Amir Amedi,Hebrew University of Jerusalem, Israel
Multisensory audio-visual-tactile training in cochlear implant patients
(4) Olivier Collingnon,Neural Rehabilitation Engineering Laboratory, Université Catholique de Louvain, Brussels, Belgium; Center for Mind/Brain Sciences (CIMeC), University of Trento, Italy
The effects of visual restoration on the blind brain

(5) Shachar Maidenbuam, Hebrew University of Jerusalem, Israel
Recruiting the visual neural navigation network for auditory navigation following lifelong and temporary visual-deprivation

Symposia 5: Practice of senses and technology (Sponsored by HengYuanXiang Group)

Chair: Lihan Chen, Peking University, China


(1)Opening Speech: Le Kang, Academician from Chinese Academy of Sciences (CAS)
(2)Representative of CACHT International Research Center For Senses
Significances of Crossed-sensory Research for people, enterprises and society
(3)Michael Haverkamp, expert for Cross-Sensory Harmonization, Ford Product Development  Centre Cologne, Germany.
Impact of Synesthesia and Cross-Sensory Interactions on multisensory Design of Brands and Products.
(4)Ying Liu, User Experience Research Scientist, Health Strategies and Solutions Group,  Intel.
User Experience Driven Innvoation: Practices in Health IT
(5) Xiaoou Li,  WorldViz LLC
Multisensory integration and virtual reality
(6) Linda Li, Givaudan Fragrances (Shanghai) Ltd
Smell and emotion
(7) Shuguang Kuai, East China Normal University
How real is real: visualizing glare effects in a virtual environment

Symposia 6:Additional Cross-Modal Sensations from private perceptions to shared associations
Organizer:  Romke Rouw Department of Psychology, Brain & Cognition,University of Amsterdam


(1)Chai-Youn Kim,Department of Psychology,Korea University
Intrinsic associations in non-synesthetic population between sound and color
(2)Amir Amedi,Hebrew University of Jerusalem
A case study of skill development and changes in phenomenology of blind users of a sensory substitution device
(3)Shachar Maidenbaum,Hebrew University of Jerusalem
Blind in a virtual world: Perception, immersion and navigation using visual-to-auditory sensory-substitution devices
(4)Romke Rouw,University of Amsterdam
Misophonia, ASMR & Synesthesia: 'special cases' or normal cross-modal integration?
(5) Xiaoang Wan, Department of Psychology, Tsinghua University
Cross-cultural differences in colour-flavour associations

At the end of this symposium there is time for a panel discussion (speakers & audience).

"Website Footer" Content will be updated soon.