This paper presents an fMRI study on healthy adult understanding of metaphors in multimodal communication. We investigated metaphors expressed either only in coverbal gestures (“monomodal metaphors”) or in speech with accompanying gestures (“multimodal metaphors”). Monomodal metaphoric gestures convey metaphoric information not expressed in the accompanying speech (e.g. saying the non-metaphoric utterance, “She felt bad” while dropping down the hand with palm facing up; here, the gesture alone indicates metaphoricity), whereas coverbal gestures in multimodal metaphors indicate metaphoricity redundant to the speech (e.g. saying the metaphoric utterance, “Her spirits fell” while dropping the hand with palm facing up). In other words, in monomodal metaphors, gestures add information not spoken, whereas the gestures in multimodal metaphors can be redundant to the spoken content. Understanding and integrating the information in each modality, here spoken and visual, is important in multimodal communication, but most prior studies have only considered multimodal metaphors where the gesture is redundant to what is spoken. Our participants watched audiovisual clips of an actor speaking while gesturing. We found that abstract metaphor comprehension recruited the lateral superior/middle temporal cortices, regardless of the modality in which the conceptual metaphor is expressed. These results suggest that abstract metaphors, regardless of modality, involve resources implicated in general semantic processing and are consistent with the role of these areas in supramodal semantic processing as well as the theory of embodied cognition.Copyright © 2020 Elsevier Inc. All rights reserved.
A novel whole blood gene expression signature for asthma, dermatitis and rhinitis multimorbidity in children and adolescents.
April 12, 2020
Dermoscopy comparative approach for early diagnosis in familial melanoma: influence of MC1R genotype.
May 28, 2020
November 27, 2019
- ACC 2020The American College of Cardiology decided to cancel ACC.20/WCC due to COVID-19, which was scheduled to take place March 28-30 in Chicago. However, ACC.20/WCC Virtual Meeting continues to release cutting edge science and practice changing updates for cardiovascular professionals on demand and free through June 2020.
- ENDO: 2020ENDO 2020 Annual Conference has been canceled due to COVID-19. Here are highlights of emerging data that has still been released. Keep an eye out for ENDO Online 2020, which will take place from June 8 to 22.
- AAN 2020Due to the global COVID-19 pandemic, the American Academy of Neurology had to cancel the AAN’s Annual Meeting originally scheduled for April 25–May 1, 2020, in Toronto.