TY - JOUR
T1 - Neural Basis of the Sound-Symbolic Crossmodal Correspondence Between Auditory Pseudowords and Visual Shapes
AU - McCormick, Kelly
AU - Lacey, Simon
AU - Stilla, Randall
AU - Nygaard, Lynne C.
AU - Sathian, K.
N1 - Funding Information:
This work was supported by grants to KS and LN from the National Eye Institute at the NIH (R01EY025978) and the Emory University Research Council, and to KM from the Emory University Facility for Education and Research in Neuroscience and the Laney Graduate School. Support to KS from the Veterans Administration is also acknowledged. We thank Lawrence Barsalou, Justin Bonny, Daniel Dilks, Evelina Fedorenko, Tami Feng, Harold Gouzoules, Sara List, Stella Lourenco and Kate Pirog Revill for their advice and assistance. KM, KS, LCN and SL designed the experiment; KM created stimuli; KM and RS performed the research and analyzed data; KM, SL, KS and LCN wrote the paper. The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. An earlier version of this manuscript has been released as a pre-print at bioRxiv.org , doi: 10.1101/478347 .
Publisher Copyright:
© 2021 Copyright by Koninklijke Brill NV, Leiden.
PY - 2021
Y1 - 2021
N2 - Sound symbolism refers to the association between the sounds of words and their meanings, often studied using the crossmodal correspondence between auditory pseudowords, e.g., 'takete' or 'maluma', and pointed or rounded visual shapes, respectively. In a functional magnetic resonance imaging study, participants were presented with pseudoword-shape pairs that were soundsymbolically congruent or incongruent. We found no significant congruency effects in the blood oxygenation level-dependent (BOLD) signal when participants were attending to visual shapes. During attention to auditory pseudowords, however, we observed greater BOLD activity for incongruent compared to congruent audiovisual pairs bilaterally in the intraparietal sulcus and supramarginal gyrus, and in the left middle frontal gyrus. We compared this activity to independent functional contrasts designed to test competing explanations of sound symbolism, but found no evidence for mediation via language, and only limited evidence for accounts based on multisensory integration and a general magnitude system. Instead, we suggest that the observed incongruency effects are likely to reflect phonological processing and/or multisensory attention. These findings advance our understanding of sound-to-meaning mapping in the brain.
AB - Sound symbolism refers to the association between the sounds of words and their meanings, often studied using the crossmodal correspondence between auditory pseudowords, e.g., 'takete' or 'maluma', and pointed or rounded visual shapes, respectively. In a functional magnetic resonance imaging study, participants were presented with pseudoword-shape pairs that were soundsymbolically congruent or incongruent. We found no significant congruency effects in the blood oxygenation level-dependent (BOLD) signal when participants were attending to visual shapes. During attention to auditory pseudowords, however, we observed greater BOLD activity for incongruent compared to congruent audiovisual pairs bilaterally in the intraparietal sulcus and supramarginal gyrus, and in the left middle frontal gyrus. We compared this activity to independent functional contrasts designed to test competing explanations of sound symbolism, but found no evidence for mediation via language, and only limited evidence for accounts based on multisensory integration and a general magnitude system. Instead, we suggest that the observed incongruency effects are likely to reflect phonological processing and/or multisensory attention. These findings advance our understanding of sound-to-meaning mapping in the brain.
UR - http://www.scopus.com/inward/record.url?scp=85113395037&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85113395037&partnerID=8YFLogxK
U2 - 10.1163/22134808-bja10060
DO - 10.1163/22134808-bja10060
M3 - Article
C2 - 34384048
AN - SCOPUS:85113395037
SN - 2213-4794
VL - 35
SP - 29
EP - 78
JO - Multisensory Research
JF - Multisensory Research
IS - 1
ER -