声调范畴感知和声调复杂度对音乐音高感知的跨领域影响

doi:10.3724/SP.J.1041.2022.01021

摘要/Abstract

摘要：

采用音高识别与区分任务, 以汉语母语者、越南语母语者和俄语母语者为研究对象, 考察了两个语言加工层面的因素, 即声调范畴感知模式以及不同语言声调系统的复杂度差异对跨领域音乐音高感知的影响。结果发现: (1)汉语和越南语两组声调语言母语者听辨结果符合范畴感知模式, 而俄语母语者是连续感知。在语言和音乐两种刺激条件下, 声调语言母语者在范畴边界宽度、范畴内区分率、范畴间区分率以及区分峰度等指标上不存在显著差异。(2)汉语和越南语两组声调语言母语者的音乐音高区分任务结果差异不显著。实验结果表明: 在行为层面, 母语声调范畴感知模式可以迁移到音乐音高感知中, 但复杂声调系统并不能促进跨领域的音乐音高精细感知。实验结果从语言对音乐音高加工影响的角度支持了“共享论”。

关键词: 范畴感知, 音高, 声调, 音乐

Abstract:

Pitch is a fundamental acoustic property shared by both language and music. However, there are different views on the processing of tonal pitch and musical pitch. Some studies support the “modularity view”, suggesting that tonal pitch and musical pitch are represented separately. In contrast, more studies support the “shared domain-general view”, implying that there are commonalities in the processing of tonal pitch and musical pitch based on their physical similarities. The existing studies have mostly focused on domain-general pitch transfer; nonetheless, they have not considered domain specificity of the tonal pitch as a linguistic element. Hence, it remains unclear whether domain specificity factors, such as categorical perception and complexity of different tonal language experiences on speakers’ pitch processing, play a role in musical pitch perception.
To address the above issues, ninety participants were involved in the experiment, including native speakers of Mandarin Chinese (with a relatively simple pitch category), native speakers of Vietnamese (with a relatively complex pitch category), and native speakers of Russian (nonpitched control group). A 3 (group: Vietnamese vs. Chinese vs. Russian) × 2 (stimulus type: speech vs. music) between-and-within-subjects design was used. A continuum from [i^?] (closed for Yinping in Chinese and Transverse in Vietnamese) to [i^??] (closed for Yangping in Chinese and Acute in Vietnamese) and its musical counterpart was constructed. Participants were first tested in an ABX identification task to determine whether the stimulus X was similar to A or B and then an AX discrimination task to decide whether the two stimuli in the pair were identical. The experiment was performed in E-prime 3.0.
The results showed that (1) both the Chinese and Vietnamese groups showed categorical perception for language and music pitches. There were no differences between language and music stimuli in category boundary width, within-category discrimination rate, between-category discrimination rate, or discrimination peak for either group. The Russian group’s identification curve did not show abrupt shifts, and their discrimination curve was relatively flat with multiple peaks, which indicates a continuous pattern significantly different from the two tonal language groups. (2) There were no significant differences between the Vietnamese group and the Chinese group in either the within-category discrimination rate or the between-category discrimination rate.
The experimental results suggest that at the behavioral level, the pattern of native tonal categorical perception can transfer to musical pitch perception, but tonal complexity does not facilitate cross-domain musical pitch perception. The findings of this study support the “shared domain-general view” in terms of the influence of language on musical pitch processing.

Key words: categorical perception, pitch, tone, music

中图分类号:

B842

李贤卓, 肖容, 梁丹丹. (2022). 声调范畴感知和声调复杂度对音乐音高感知的跨领域影响. 心理学报, 54(9), 1021-1030.

LI Xianzhuo, XIAO Rong, LIANG Dandan. (2022). The cross-domain influence of tonal categorical perception and tonal complexity on musical pitch perception. Acta Psychologica Sinica, 54(9), 1021-1030.

图/表 8

参考文献 42

[1]	Asaridou, S. S., & Mcqueen, J. M. (2013). Speech and music shape the listening brain: Evidence for shared domain- general mechanisms. Frontiers in Psychology, 4(4), 1-14.
[2]	Bent, T., Bradlow, A. R., & Wright, B. A. (2006). The influence of linguistic experience on the cognitive processing of pitch in speech and nonspeech sounds. Journal of Experimental Psychology Human Perception & Performance, 32(1), 97-103.
[3]	Besson, M., Chobert, J., & Marie, C. (2011). Transfer of training between music and speech: Common processing, attention, and memory. Frontiers in Psychology, 2, 1-11.
[4]	Bidelman, G. M., Hutka, S., & Moreno, S. (2013). Tone language speakers and musicians share enhanced perceptual and cognitive abilities for musical pitch: Evidence for bidirectionality between the domains of language and music. PLoS ONE, 8(4), Article e60676. doi: 10.1371/journal.pone.0060676 URL
[5]	Bidelman, G. M., & Walker, B. S. (2017). Attentional modulation and domain-specificity underlying the neural organization of auditory categorical perception. European Journal of Neuroscience, 45(5), 690-699. doi: 10.1111/ejn.13526 pmid: 28112440
[6]	Bradley, E. D. (2013). Pitch perception in lexical tone and melody. Reviews of Research in Human Learning and Music, 1: Epub2013002.
[7]	Chang, D., Hedberg, N., & Wang, Y. (2016). Effects of musical and linguistic experience on categorization of lexical and melodic tones. Journal of the Acoustical Society of America, 139(5), 2432-2447. doi: 10.1121/1.4947497 URL
[8]	Chen, A., Liu, L., & Kager, R. (2016). Cross-domain correlation in pitch perception, the influence of native language. Language, Cognition and Neuroscience, 31(6), 751-760. doi: 10.1080/23273798.2016.1156715 URL
[9]	Chen, A., Peter, V., Wijnen, F., Schnack, H., & Burnham, D. (2018). Are lexical tones musical? Native language’s influence on neural response to pitch in different domains. Brain and Language, 180-182(15), 31-41. doi: 10.1016/j.bandl.2018.04.006 URL
[10]	Chen, Z., Peng, L., Wang, E. Q., Larson, C. R., Huang, D., & Liu, H. (2012). ERP correlates of language-specific processing of auditory pitch feedback during self- vocalization. Brain & Language, 121(1), 25-34.
[11]	Cooper, A., & Wang, Y. (2012). The influence of linguistic and musical experience on Cantonese word learning. Journal of the Acoustical Society of America, 131(6), 4756-4769. doi: 10.1121/1.4714355 URL
[12]	Giuliano, R. J., Pfordresher, P., Stanley, E. M., Narayana, S., & Wicha, N. Y. Y. (2011). Native experience with a tone language enhances pitch discrimination and the timing of neural responses to pitch change. Frontiers in Psychology, 2, 1-12.
[13]	Greenwood, D. D. (1961). Critical bandwidth and the frequency coordinates of the basilar membrane. Journal of the Acoustical Society of America, 33(10), 1344-1356. doi: 10.1121/1.1908437 URL
[14]	Guo, J. F. (1993). Probe into Chinese tone and intonation, Beijing: Beijing Language Institute Press.
	[郭锦桴. (1993). 汉语声调语调阐要与探索. 北京: 北京语言学院出版社.]
[15]	Hallé, P. A., Chang, Y.-C., & Best, C. T. (2004). Identification and discrimination of Mandarin Chinese tones by Mandarin Chinese vs. French listeners. Journal of Phonetics, 32(3), 395-421. doi: 10.1016/S0095-4470(03)00016-0 URL
[16]	Hutka, S., Bidelman, G. M., & Moreno, S. (2015). Pitch expertise is not created equal: Cross-domain effects of musicianship and tone language experience on neural and behavioural discrimination of speech and music. Neuropsychologia, 71, 52-63. doi: 10.1016/j.neuropsychologia.2015.03.019 URL
[17]	Jiang, C., Hamm, J. P., Lim, V. K., Kirk, I. J., & Yang, Y. (2012). Impaired categorical perception of lexical tones in Mandarin-speaking congenital amusics. Memory & Cognition, 40(7), 1109-1121. doi: 10.3758/s13421-012-0208-2 URL
[18]	Krishnan, A., Swaminathan, J., & Gandour, J. T. (2009). Experience-dependent enhancement of linguistic pitch representation in the brainstem is not specific to a speech context. Journal of Cognitive Neuroscience, 21(6), 1092-1105. doi: 10.1162/jocn.2009.21077 URL
[19]	Lee, C.-Y., & Hung, T.-H. (2008). Identification of Mandarin tones by English-speaking musicians and nonmusicians. Journal of the Acoustical Society of America, 124(5), 3235-3248. doi: 10.1121/1.2990713 URL
[20]	Liberman, A. M., Harris, K. S., Hoffman, H. S., & Griffith, B. C. (1957). The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology, 54(5), 358-368. doi: 10.1037/h0044417 URL
[21]	Marie, C., Delogu, F., Lampis, G., Belardinelli, M. O., & Besson, M. (2011). Influence of musical expertise on segmental and tonal processing in Mandarin Chinese. Journal of Cognitive Neuroscience, 23(10), 2701-2715. doi: 10.1162/jocn.2010.21585 URL
[22]	Marques, C., Moreno, S., Castro, S. L., & Besson, M. (2007). Musicians detect pitch violation in a foreign language better than nonmusicians: Behavioral and electrophysiological evidence. Journal of Cognitive Neuroscience, 19(9), 1453-1463. pmid: 17714007
[23]	Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9(1), 97-113. pmid: 5146491
[24]	Patel, A. D. (2008). Music, language, and the brain. New York: Oxford University Press.
[25]	Patel, A. D. (2012). The opera hypothesis:Assumptions and clarifications. Annals of the New York Academy of Sciences, 1252(1), 124-128.
[26]	Peng, G., Zheng, H.-Y., Gong, T., Yang, R.-X., Kong, J.-P., & Wang, W. S.-Y. (2010). The influence of language experience on categorical perception of pitch contours. Journal of Phonetics, 38(4), 616-624. doi: 10.1016/j.wocn.2010.09.003 URL
[27]	Peretz, I., Champod, A. S., & Hyde, K. (2003). Varieties of musical disorders——The montreal battery of evaluation of amusia. Annals of the New York Academy of Sciences, 999, 58-75.
[28]	Peretz, I., & Coltheart, M. (2003). Modularity of music processing. Nature Neuroscience, 6(7), 688-691. doi: 10.1038/nn1083 URL
[29]	Peretz, I., Nguyen, S., & Cummings, S. (2011). Tone language fluency impairs pitch discrimination. Frontiers in Psychology, 2, 1-5.
[30]	Pfordresher, P., & Brown, S. (2009). Enhanced production and perception of musical pitch in tone language speakers. Attention, Perception, & Psychophysics, 71(6), 1385-1398. doi: 10.3758/APP.71.6.1385 URL
[31]	Phan, V. T. (2008). An analysis of the acoustic features of static tones in Vietnamese. Journal of Yunnan Normal University (Teaching Chinese as a Foreign Language and Research Edition), 6(4), 59-65.
	[潘武俊英. (2008). 越南语静态声调的声学分析. 云南师范大学学报(对外汉语教学与研究版), 6(4), 59-65.]
[32]	Schön, D., Magne, C., & Besson, M. (2004). The music of speech: Music training facilitates pitch processing in both music and language. Psychophysiology, 41(3), 341-349. doi: 10.1111/1469-8986.00172.x URL
[33]	Shen, G., & Froud, K. (2016). Categorical perception of lexical tones by English learners of Mandarin Chinese. Journal of the Acoustical Society of America, 140(6), 4396-4403. doi: 10.1121/1.4971765 URL
[34]	Tong, X., Choi, W., & Man, Y. Y. (2018). Tone language experience modulates the effect of long-term musical training on musical pitch perception. Journal of the Acoustical Society of America, 144(2), 690-697. doi: 10.1121/1.5049365 URL
[35]	Wang, W. S. (1976). Language change. Annals of the New York Academy of Sciences, 280(1), 61-72.
[36]	Weidema, J. L., Roncaglia-Denissen, M. P., & Honing, H. (2016). Top-down modulation on the perception and categorization of identical pitch contours in speech and music. Frontiers in Psychology, 7, 1-11.
[37]	Xian, M. X. (2016). Historical hierarchical analysis of relational morphemes in Chinese and Vietnamese. Shanghai: Zhongxi Publishing House.
	[咸蔓雪. (2016). 汉语越南语关系语素历史层次分析. 上海: 中西书局.]
[38]	Xu, Y., Gandour, J. T., & Francis, A. L. (2006). Effects of language experience and stimulus complexity on the categorical perception of pitch direction. Journal of the Acoustical Society of America, 120(2), 1063-1074. doi: 10.1121/1.2213572 URL
[39]	Yip, M. (2002). Tone. Cambridge: Cambridge University Press.
[40]	Zentner, M., & Strauss, H. (2017). Assessing musical ability quickly and objectively:Development and validation of the short‐proms and the mini‐proms. Annals of the New York Academy of Sciences, 1400(1), 33-45.
[41]	Zheng, H.-Y., Minett, J. W., Peng, G., & Wang, W. S.-Y. (2012). The impact of tone systems on the categorical perception of lexical tones: An Event-Related Potentials study. Language and Cognitive Processes, 27(2), 184-209. doi: 10.1080/01690965.2010.520493 URL
[42]	Zheng, H.-Y., Peng, G., Chen, J., Zhang, C., Minett, J. W., & Wang, W. S. (2014). The influence of tone inventory on ERP without focal attention: A cross-language study. Computational and Mathematical Methods in Medicine, Article 961563.

汉语普通话调类	调值	越南语调类	调值
阴平	55	横声	55
阳平	35	玄声	211
上声	214	问声	213
去声	51	跌声	21-4
		锐声	35
		重声	1

汉语普通话调类	调值	越南语调类	调值
阴平	55	横声	55
阳平	35	玄声	211
上声	214	问声	213
去声	51	跌声	21-4
		锐声	35
		重声	1

组别	语音刺激		音乐刺激
组别	斜率	范畴边界宽度	斜率	范畴边界宽度
越南语组	-1.83(0.45)	1.28(0.34)	-2.20(0.58)	1.06(0.27)
汉语组	-2.39(0.70)	1.02(0.38)	-2.43(0.54)	0.94(0.17)
俄语组	-0.79(0.79)	26.69(99.29)	-0.83(0.84)	10.48(14.92)

组别	语音刺激		音乐刺激
组别	斜率	范畴边界宽度	斜率	范畴边界宽度
越南语组	-1.83(0.45)	1.28(0.34)	-2.20(0.58)	1.06(0.27)
汉语组	-2.39(0.70)	1.02(0.38)	-2.43(0.54)	0.94(0.17)
俄语组	-0.79(0.79)	26.69(99.29)	-0.83(0.84)	10.48(14.92)

组别	语音刺激			音乐刺激
组别	范畴内区分率	范畴间区分率	峰度	范畴内区分率	范畴间区分率	峰度
越南语组	0.55 (0.07)	0.60 (0.09)	0.05 (0.07)	0.56 (0.05)	0.56 (0.09)	0.07 (0.09)
汉语组	0.55 (0.12)	0.60 (0.15)	0.03 (0.17)	0.58 (0.06)	0.66 (0.11)	0.12 (0.12)
俄语组	0.51 (0.13)	0.49 (0.24)	-0.07 (0.25)	0.48 (0.21)	0.51 (0.25)	-0.04 (0.23)