Causal inference in the multisensory brain

Journal article

When combining information across different senses humans need to flexibly select cues of a common origin whilst avoiding distraction from irrelevant inputs. The brain could solve this challenge using a hierarchical principle, by deriving rapidly a fused sensory estimate for computational expediency and, later and if required, filtering out irrelevant signals based on the inferred sensory cause(s). Analysing time- and source- resolved human magnetoencephalographic data we unveil a systematic spatio- temporal cascade of the relevant computations, starting with early segregated unisensory representations, continuing with sensory fusion in parietal-temporal regions and culminating as causal inference in the frontal lobe. Our results reconcile previous computational accounts of multisensory perception by showing that prefrontal cortex guides flexible integrative behaviour based on candidate representations established in sensory and association cortices, thereby framing multisensory integration in the generalised context of adaptive behaviour.

Authors: Cao, Y; Summerfield, C; Park, H; Giordano, B; Kayser, C

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Elsevier
• Journal: Neuron
• Volume: 102
• Issue: 5
• Pages: 1076-1087.e8
• Publication date: 2019-04-29
• Acceptance date: 2019-03-27
• DOI: 10.1016/j.neuron.2019.03.043
• EISSN: 1097-4199
• ISSN: 0896-6273
• Language: English
• Keywords: flexible behavior; structure inference; parietal cortex; sensory fusion; ventrolateral prefrontal cortex; representational similarity analysis; crossmodal; causal inference; decision making; MEG; magnetoencephalography