Article View/Open
Publication Export
Related Publications in TAIR
- > Simple Record
- > Full Record
Field |
Value |
Title: | Neural correlates of the processing of self-adaptors, emblems, and iconic gestures with speech: an fMRI study |
Authors: | 徐嘉慧 Chui, Kawai Yeh, Kanyu Chui, Kawai |
Contributors: | 英文系 |
Keywords: | Self-adaptor; emblem; iconic gesture; gesture-speech processing |
Date: | 2020-01 |
Issue Date: | 2021-06-11 09:44:25 (UTC+8) |
Abstract: | Various types of arm-and-hand movements co-occurring with speech give rise to diverse crossmodal semantic relations. This study investigated how the brain processes self-adaptors, emblems, and iconic gestures with the same speech by using fMRI. Gestures with speech evoked bilateral fusiform gyrus and left supramarginal gyrus in visual and multisensory processing. These regions were involved in processing conventional forms and meanings in emblems with speech. Iconic gestures uniquely activated right supramarginal gyrus associated with spatial processing of unconventional configurations of event knowledge of lexical concepts. Self-adaptors without meaning particularly involved the left superior parietal lobule in directing spatial attention to hand movements and processing spatio-motoric attributes with motor representations. Without gestures, bilateral superior temporal gyrus and calcarine sulcus were engaged in processing sounds and meanings of audiovisual speech. The overall results demonstrate the brain’s sensitivity to gesture-speech semantic variation, and reveal the nature of knowledge in the involved neural regions. |
Relation: | Language, Cognition and Neuroscience, Vol.35, pp.1-22 |
Data Type: | article |
DOI: | https://doi.org/10.1080/23273798.2020.1853785 |
DCField |
Value |
Language |
dc.contributor (Contributor) | 英文系 | |
dc.creator (Authors) | 徐嘉慧 | |
dc.creator (Authors) | Chui, Kawai | |
dc.creator (Authors) | Yeh, Kanyu | |
dc.creator (Authors) | Chui, Kawai | |
dc.date (Date) | 2020-01 | |
dc.date.accessioned | 2021-06-11 09:44:25 (UTC+8) | - |
dc.date.available | 2021-06-11 09:44:25 (UTC+8) | - |
dc.date.issued (Issue Date) | 2021-06-11 09:44:25 (UTC+8) | - |
dc.identifier.uri (URI) | http://nccur.lib.nccu.edu.tw/handle/140.119/135747 | - |
dc.description.abstract (Abstract) | Various types of arm-and-hand movements co-occurring with speech give rise to diverse crossmodal semantic relations. This study investigated how the brain processes self-adaptors, emblems, and iconic gestures with the same speech by using fMRI. Gestures with speech evoked bilateral fusiform gyrus and left supramarginal gyrus in visual and multisensory processing. These regions were involved in processing conventional forms and meanings in emblems with speech. Iconic gestures uniquely activated right supramarginal gyrus associated with spatial processing of unconventional configurations of event knowledge of lexical concepts. Self-adaptors without meaning particularly involved the left superior parietal lobule in directing spatial attention to hand movements and processing spatio-motoric attributes with motor representations. Without gestures, bilateral superior temporal gyrus and calcarine sulcus were engaged in processing sounds and meanings of audiovisual speech. The overall results demonstrate the brain’s sensitivity to gesture-speech semantic variation, and reveal the nature of knowledge in the involved neural regions. | |
dc.format.extent | 3692143 bytes | - |
dc.format.mimetype | application/pdf | - |
dc.relation (Relation) | Language, Cognition and Neuroscience, Vol.35, pp.1-22 | |
dc.subject (Keywords) | Self-adaptor; emblem; iconic gesture; gesture-speech processing | |
dc.title (Title) | Neural correlates of the processing of self-adaptors, emblems, and iconic gestures with speech: an fMRI study | |
dc.type (Data Type) | article | |
dc.identifier.doi (DOI) | 10.1080/23273798.2020.1853785 | |
dc.doi.uri | https://doi.org/10.1080/23273798.2020.1853785 | |