ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

心理科学进展 ›› 2022, Vol. 30 ›› Issue (8): 1818-1831.doi: 10.3724/SP.J.1042.2022.01818

• 研究前沿 • 上一篇    下一篇

节律在听觉言语理解中的作用

陈梁杰, 刘雷, 葛钟书, 杨晓东, 李量()   

  1. 北京大学心理与认知科学学院, 北京 100080
  • 收稿日期:2021-07-07 出版日期:2022-08-15 发布日期:2022-06-23
  • 通讯作者: 李量 E-mail:liangli@pku.edu.cn
  • 基金资助:
    国家自然科学基金面上项目(31771252);国家自然科学基金面上项目(32071057)

The role of rhythm in auditory speech understanding

CHEN Liangjie, LIU Lei, GE Zhongshu, YANG Xiaodong, LI Liang()   

  1. School of Psychological and Cognitive Sciences, Peking University, Beijing 100080, China
  • Received:2021-07-07 Online:2022-08-15 Published:2022-06-23
  • Contact: LI Liang E-mail:liangli@pku.edu.cn

摘要:

言语理解是听者接受外部语音输入并且获得意义的心理过程。日常交流中, 听觉言语理解受多尺度节律信息的影响, 常见有韵律结构节律、语境节律、和说话者身体语言节律三方面外部节律。它们改变听者在言语理解中的音素判别、词汇感知以及言语可懂度等过程。内部节律表现为大脑内神经振荡, 其能够表征外部言语输入在不同时间尺度下的层级特征。外部节律性刺激与内部神经活动的神经夹带能够优化大脑对言语刺激的处理, 并受到听者自上而下的认知过程的调节进一步增强目标言语的内在表征。我们认为它可能是实现内外节律相互联系并共同影响言语理解的关键机制。对内外节律及其联系机制的揭示能够为理解言语这种在多层级时间尺度上具有结构规律的复杂序列提供了一个研究窗口。

关键词: 节律, 言语理解, 神经振荡, 神经夹带, 自上而下调节

Abstract:

For a long time, the research of rhythm has mainly focused on sensory and perceptual processing, ignoring its role in speech comprehension. Oral speech, as an important channel of information exchange in human society, has rich rhythmic characteristics, and its understanding is that listeners receive external speech input and obtain meaning. In daily communication, auditory speech comprehension is influenced by multiscale rhythm information. Common external rhythms showed below. Prosodic structure rhythm can affect the intelligibility of auditory speech and help listeners to analyze sentence structure in an ambiguous context. Context rhythm changes the listener's judgment of the number of words and affects the recognition of vowels and consonants in words. Body language rhythm can alter stress position perception and restore speech intelligibility. The influence of external rhythm on auditory speech comprehension exists in a wide range of auditory and non-auditory stimuli, which help the listeners to understand the speaker's speech content. The process by which the listener's brain uses external rhythms to promote or alter speech comprehension is thought to be related to internal rhythms. Internal rhythms are neural oscillations, which can represent the hierarchical characteristics of external speech input at different time scales and tend to be coupled with each other. The convergence of internal and external rhythms over time with the input of external rhythmic stimuli is called neural entrainment. Neural entrainment of external rhythmic stimuli and internal neural activity can optimize the brain's processing of speech stimuli and extract discrete language components from continuous sound signals. It's worth noting that neural entrainment is not only a passive follower of external rhythm information but also influenced by the subjective regulation of listeners. In the process of speech comprehension, top-down modulation may be derived from cognitive processes such as the listener's selective attention, prior knowledge of grammar, and expectation. They can affect neural entrainment at the same time. When the listener pays selective attention to a stream of speech, it weakened or eliminated the advanced neural response of the brain regions to not pay attention to the voice stream. And neural entrainment based on the corresponding component in the listener is expected to enhance speech representation and processing. And neural entrainment relied on the listener of the existing prior knowledge to integrate words composition between different levels or across brain areas. These active modulations make the key information in the process of speech comprehension more likely to be at the optimal excitability level of neuron cluster activity, thus obtaining more processing resources. We believe that neural entrainment may be the key mechanism to realize the interrelation between internal and external rhythms and jointly affect speech comprehension. Finally, the discovery of internal and external rhythms and their related mechanisms can provide a research window for understanding speech, a complex sequence with structural rules in multilevel time scales.

Key words: rhythm, speech understanding, neural oscillation, neural entrainment, top-down modulation

中图分类号: