Assessing the effects of audiovisual semantic congruency on the perception of a bistable figure.

Journal article

Bistable figures provide a fascinating window through which to explore human visual awareness. Here we demonstrate for the first time that the semantic context provided by a background auditory soundtrack (the voice of a young or old female) can modulate an observer's predominant percept while watching the bistable "my wife or my mother-in-law" figure (Experiment 1). The possibility of a response-bias account-that participants simply reported the percept that happened to be congruent with the soundtrack that they were listening to-was excluded in Experiment 2. We further demonstrate that this crossmodal semantic effect was additive with the manipulation of participants' visual fixation (Experiment 3), while it interacted with participants' voluntary attention (Experiment 4). These results indicate that audiovisual semantic congruency constrains the visual processing that gives rise to the conscious perception of bistable visual figures. Crossmodal semantic context therefore provides an important mechanism contributing to the emergence of visual awareness.

Authors: Hsiao, J; Chen, Y; Spence, C; Yeh, S

• Publication status: Published
• Journal: Consciousness and cognition
• Volume: 21
• Issue: 2
• Pages: 775-787
• Publication date: 2012-06-01
• DOI: 10.1016/j.concog.2012.02.001
• EISSN: 1090-2376
• ISSN: 1053-8100
• Language: English
• Keywords: Photic Stimulation; Acoustic Stimulation; Visual Perception; Semantics; Awareness; Auditory Perception; Humans; Attention