Effects of visual language on reading among people who are deaf and hard of hearing and the underlying mechanisms

doi:10.3724/SP.J.1042.2020.00969

Abstract

Abstract:

The auditory channel is disabled for people who are deaf and hard of hearing, so they have to rely heavily on visual language — lip-reading and sign language — to develop their reading ability. Lip-reading can help deaf and hard-of-hearing people to form phonological representation, develop vocabulary knowledge, and promote word reading and reading comprehension. Oral and written language processing activates sign language, which affects all levels of reading ability for people who are deaf and hard of hearing. Future research should explore the role of reading skills such as phonological awareness and vocabulary knowledge in the effect of visual language on reading ability, and develop a theoretical model that explains the mechanisms underlying reading acquisition by visual language for Chinese people who are deaf and hard of hearing.

Key words: deaf and hard-of-hearing people, visual language, reading ability, lip-reading, sign language

CLC Number:

ZHAO Ying, WU Xinchun, XIE Ruibo, FENG Jie, SUN Peng, CHEN Hongjun. Effects of visual language on reading among people who are deaf and hard of hearing and the underlying mechanisms[J]. Advances in Psychological Science, 2020, 28(6): 969-977.

References 72

[1]	陈乐乐 . (2015). 聋儿手语与其认知发展研究述评. 中国特殊教育, (3), 26-31.
[2]	邓慧兰 . (2014). 聋童语言获得与手语双语共融教育: 语言科学研究之知识转移. 语言科学, 13(1), 24-33.
[3]	丁国盛, 李妍妍 . (2012). 聋人早期手语经验对脑功能及结构的塑造作用. 心理科学进展, 20(3), 328-337.
[4]	方俊明, 何大芳 . (2003). 中国聋人手语脑功能成像的研究. 中国特殊教育, (2), 50-57.
[5]	雷江华 . (2009). 听觉障碍学生唇读的认知研究. 北京: 中国社会科学出版社.
[6]	雷江华, 方俊明 . (2005). 聋人唇读的大脑机制研究. 心理科学, 28(1), 10-12.
[7]	雷江华, 刘昌, 方俊明, 李建奇, 王丽佳 . (2014). 听觉障碍学生唇读的fMRI研究. 教育研究与实验, (3), 69-72.
[8]	雷江华, 孙灯勇, 刘昌, 方俊明 . (2010). 语音编码在聋生唇读汉字语音识别中的作用. 心理科学, 33(2), 315-317.
[9]	李德高, 张积家 . (2006). 先天聋人的语音、正字法意识和概念知识结构. 心理科学进展, 14(3), 354-359.
[10]	李俊宏, 丁国盛 . (2013). 手语和口语理解及产生的脑机制对比. 心理科学进展, 21(9), 1560-1569.
[11]	刘卿 . (2010). 九年制聋校毕业生书面语言能力发展研究——以南京特教学院2007-2009年聋生语文升学试卷分析为例. 中国特殊教育, (6), 29-34.
[12]	Alegría, J., & Lechat, J . (2005). Phonological processing in deaf children: When lipreading and cues are incongruent. Journal of Deaf Studies and Deaf Education, 10(2), 122-133.
[13]	Allen, T. E . (2015). ASL skills, fingerspelling ability, home communication context and early alphabetic knowledge of preschool-aged deaf children. Sign Language Studies, 15(3), 233-265.
[14]	Andrew, K. N., Hoshooley, J., & Joanisse, M. F . (2014). Sign language ability in young deaf signers predicts comprehension of written sentences in English. Plos One, 9(2), e89994.
[15]	Andrews, J. F., Hamilton, B., Dunn, K. M., & Clark, M. D . (2016). Early reading for young deaf and hard of hearing children: Alternative frameworks. Psychology, 7(4), 510-522.
[16]	Aparicio, M., Peigneux, P., Charlier, B., Baleriaux, D., Kavec, M., & Leybaert, J . (2017). The neural basis of speech perception through lipreading and manual cues: Evidence from deaf native users of cued speech. Frontiers in Psychology, 8, 426.
[17]	Baron, J., & Strawson, C . (1976). Use of orthographic and word-specific knowledge in reading words aloud. Journal of Experimental Psychology: Human Perception and Performance, 2(3), 386-393.
[18]	Bernstein, L. E., Demorest, M. E., & Tucker, P. E . (1998) . What makes a good speechreader? First you have to find one. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye II (pp. 211-227). Hove, East Sussex: Psychology Press.
[19]	Bernstein, L. E., Tucker, P. E., & Demorest, M. E . (2000). Speech perception without hearing. Perception & Psychophysics, 62(2), 233-252.
[20]	Binder, K. S., Cote, N. G., Lee, C., Bessette, E., & Vu, H . (2017). Beyond breadth: The contributions of vocabulary depth to reading comprehension among skilled readers. Journal of Research in Reading, 40(3), 333-343.
[21]	Capek, C. M., Macsweeney, M., Woll, B., Waters, D., Mcguire, P. K., David, A. S., ... Campbell, R . (2008). Cortical circuits for silent speechreading in deaf and hearing people. Neuropsychologia, 46(5), 1233-1241.
[22]	Chiu, Y. S., & Wu, M. D . (2016). Use of phonological representations of Taiwan sign language in Chinese reading: Evidence from deaf signers. Bulletin of Special Education, 41(1), 91-109.
[23]	Clark, M. D., Hauser, P. C., Miller, P., Kargin, T., Rathmann, C., Guldenoglu, B., ... Israel, E . (2016). The importance of early sign language acquisition for deaf readers. Reading & Writing Quarterly, 32(2), 127-151.
[24]	Coltheart, M., Rastle, K., Perry, C., Langdon, R., & Ziegler, J . (2001). DRC: A dual route cascaded model of visual word recognition and reading aloud. Psychological Review, 108(1), 204-256.
[25]	Corina, D. P., Hafer, S., & Welch, K . (2014). Phonological awareness for American sign language. Journal of Deaf Studies and Deaf Education, 19(4), 530-545.
[26]	Davidson, K., Lillo-Martin, D., & Pichler, D. C . (2014). Spoken English language development among native signing children with cochlear implants. Journal of Deaf Studies and Deaf Education, 19(2), 238-250.
[27]	Dodd, B . (1987). Lip-reading, phonological coding, and deafness. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading ( pp. 177-189). London: Lawrence Erlbaum.
[28]	Dodd, B., & Hermelin, B . (1977). Phonological coding by the prelinguistically deaf. Perception & Psychophysics, 21(5), 413-417.
[29]	Ehri, L. C . (1995). Phases of development in learning to read words by sight. Journal of Research in Reading, 18(2), 116-125.
[30]	Ehri, L. C . (2005). Learning to read words: Theory, findings, and issues. Scientific Studies of Reading, 9(2), 167-188.
[31]	Elliott, E. A., Braun, M., Kuhlmann, M., & Jacobs, A. M . (2012). A dual-route cascaded model of reading by deaf adults: Evidence for grapheme to viseme conversion. Journal of Deaf Studies and Deaf Education, 17(2), 227-243.
[32]	Elphick, R . (1996). Issues in comparing the speechreading abilities of hearing-impaired and hearing 15 to 16 year-old pupils. British Journal of Educational Psychology, 66(3), 357-365.
[33]	Goldin-Meadow, S., & Mayberry, R. I . (2001). How do profoundly deaf children learn to read? Learning Disabilities Research & Practice, 16(4), 222-229.
[34]	Gough, P. B., & Tunmer, W. E . (1986). Decoding, reading, and reading disability. Remedial and Special Education, 7(1), 6-10.
[35]	Grosvald, M., Gutierrez, E., Hafer, S., & Corina, D . (2012). Dissociating linguistic and non-linguistic gesture processing: Electrophysiological evidence from American sign language. Brain and Language, 121(1), 12-24.
[36]	Gutierrez, E., Williams, D., Grosvald, M., & Corina, D . (2012). Lexical access in American sign language: An ERP investigation of effects of semantics and phonology. Brain Research, 1468, 63-83.
[37]	Harris, M., & Moreno, C . (2006). Speech reading and learning to read: A comparison of 8-year-old profoundly deaf children with good and poor reading ability. Journal of Deaf Studies and Deaf Education, 11(2), 189-201.
[38]	Harris, M., Terlektsi, E., & Kyle, F. E . (2017a). Concurrent and longitudinal predictors of reading for deaf and hearing children in primary school. Journal of Deaf Studies and Deaf Education, 22(2), 233-242. doi: 10.1093/deafed/enw101 URL
[39]	Harris, M., Terlektsi, E., & Kyle, F. E . (2017b). Literacy outcomes for primary school children who deaf and hard of hearing: A cohort comparison study. Journal of Speech, Language, and Hearing Research, 60(3), 701-711.
[40]	Herman, R., Kyle, F. E., & Roy, P . (2019). Literacy and phonological skills in oral deaf children and hearing children with a history of dyslexia. Reading Research Quarterly, 54(4), 553-575.
[41]	Hermans, D., Knoors, H., Ormel, E., & Verhoeven, L . (2008). Modeling reading vocabulary learning in deaf children in bilingual education programs. Journal of Deaf Studies and Deaf Education, 13(2), 155-174.
[42]	Hoffmeister, R. J., & Caldwell-Harris, C. L . (2014). Acquiring English as a second language via print: The task for deaf children. Cognition, 132(2), 229-242.
[43]	Hoover, W. A., & Gough, P. B . (1990). The simple view of reading. Reading and writing, 2(2), 127-160.
[44]	Jerger, S., Tye-Murray, N., Damian, M., & Abdi, H . (2016). Phonological priming in children with hearing loss: Effect of speech mode, fidelity, and lexical status. Ear and Hearing, 37(6), 623-633.
[45]	Kyle, F. E., Campbell, R., & MacSweeney, M . (2016). The relative contributions of speechreading and vocabulary to deaf and hearing children's reading ability. Research in Developmental Disabilities, 48, 13-24.
[46]	Kyle, F. E., Campbell, R., Mohammed, T., Coleman, M., & MacSweeney, M . (2013). Speechreading development in deaf and hearing children: Introducing the test of child speechreading. Journal of Speech, Language, and Hearing Research, 56(2), 416-426.
[47]	Kyle, F. E., & Harris, M . (2006). Concurrent correlates and predictors of reading and spelling achievement in deaf and hearing school children. Journal of Deaf Studies and Deaf Education, 11(3), 273-288.
[48]	Kyle, F. E., & Harris, M . (2010). Predictors of reading development in deaf children: A 3-year longitudinal study. Journal of Experimental Child Psychology, 107(3), 229-243.
[49]	Kyle, F. E., & Harris, M . (2011). Longitudinal patterns of emerging literacy in beginning deaf and hearing readers. Journal of Deaf Studies and Deaf Education, 16(3), 289-304.
[50]	Lederberg, A. R., Schick, B., & Spencer, P. E . (2013). Language and literacy development of deaf and hard-of- hearing children: Successes and challenges. Developmental Psychology, 49(1), 15-30.
[51]	Luckner, J. L., & Cooke, C . (2010). A summary of the vocabulary research with students who are deaf or hard of hearing. American Annals of the Deaf, 155(1), 38-67.
[52]	MacSweeney, M., Waters, D., Brammer, M.J., Woll, B., & Goswami, U . (2008). Phonological processing in deaf signers and the impact of age of first language acquisition. NeuroImage, 40(3), 1369-1379.
[53]	Mayberry, R. I., Chen, J., Witcher, P., & Klein, D . (2011). Age of acquisition effects on the functional organization of language in the adult brain. Brain and Language, 119(1), 16-29.
[54]	McBride-Chang, C., Tong, X., Shu, H., Wong, A. M.-Y., Leung, K.-W., & Tardif, T . (2008). Syllable, phoneme, and tone: Psycholinguistic units in early Chinese and English word recognition. Scientific Studies of Reading, 12(2), 171-194.
[55]	Mcgurk, H., & Macdonald, J . (1976). Hearing lips and seeing voices. Nature, 264(5588), 746-748.
[56]	Moeller, M., Tomblin, J., Yoshinaga-Itano, C., Connor, C., & Jerger, S . (2007). Current state of knowledge: Language and literacy of children with hearing impairment. Ear and Hearing, 28(6), 740-753. doi: 10.1097/AUD.0b013e318157f07f URL
[57]	Mohammed, T., Campbell, R., MacSweeney, M., Barry, F., & Coleman, M . (2006). Speechreading and its association with reading among deaf, hearing and dyslexic individuals. Clinical Linguistics & Phonetics, 20(7-8), 621-630.
[58]	Morford, J. P., Wilkinson, E., Villwock, A., Piñar, P., & Kroll, J. F . (2011). When deaf signers read English: Do written words activate their sign translations? Cognition, 118(2), 286-292.
[59]	Nation, K., Cocksey, J., Taylor, J. S. H., & Bishop, D. V. M . (2010). A longitudinal investigation of early reading and language skills in children with poor reading comprehension. Journal of Child Psychology and Psychiatry, 51(9), 1031-1039. doi: 10.1111/j.1469-7610.2010.02254.x URL
[60]	Nishimura, H., Hashikawa, K., Doi, K., Iwaki, T., Watanabe, Y., Kusuoka, H., ... Kubo, T . (1999). Sign language 'heard' in the auditory cortex. Nature, 397(6715), 116.
[61]	Ormel, E., Hermans, D., Knoors, H., & Verhoeven, L . (2009). The role of sign phonology and iconicity during sign processing: The case of deaf children. Journal of Deaf Studies and Deaf Education, 14(4), 436-448.
[62]	Ormel, E., Hermans, D., Knoors, H., & Verhoeven, L . (2012). Cross-language effects in written word recognition: The case of bilingual deaf children. Bilingualism: Language and Cognition, 15(2), 288-303. doi: 10.1017/S1366728911000319 URL
[63]	Pan, J., Shu, H., Wang, Y., & Yan, M . (2015). Parafoveal activation of sign translation previews among deaf readers during the reading of Chinese sentences. Memory & Cognition, 43(6), 964-972.
[64]	Perfetti, C. A., & Sandak, R . (2000). Reading optimally builds on spoken language: Implications for deaf readers. Journal of Deaf Studies and Deaf Education, 5(1), 32-50. doi: 10.1093/deafed/5.1.32 URL
[65]	Rodríguez-Ortiz, I. R., Saldaña, D., & Moreno-Perez, F. J . (2017). How speechreading contributes to reading in a transparent orthography: The case of Spanish deaf people. Journal of Research in Reading, 40(1), 75-90.
[66]	Sadato, N., Yamada, H., Okada, T., Yoshida, M., Hasegawa, T., Matsuki, K., ... Itoh, H . (2004). Age-dependent plasticity in the superior temporal sulcus in deaf humans: A Functional MRI study. BMC Neuroscience, 5(1), 56.
[67]	Shu, H., Peng, H., & McBride-Chang, C . (2008). Phonological awareness in young Chinese children. Developmental Science, 11(1), 171-181.
[68]	Strong, M., & Prinz, P. M . (1997). A study of the relationship between American sign language and English literacy. Journal of Deaf Studies and Deaf Education, 2(1), 37-46.
[69]	Su, M., de Schotten, M. T., Zhao, J., Song, S., Zhou, W., Gong, G., ... Shu, H . (2018). Vocabulary growth rate from preschool to school-age years is reflected in the connectivity of the arcuate fasciculus in 14-year-old children. Developmental Science, 21(5), e12647.
[70]	Thierfelder, P., & Stapleton, P . (2016). Errors in the written English of native users of sign language: An exploratory case study of Hong Kong deaf students. System, 58, 12-24.
[71]	Vellutino, F. R., Fletcher, J. M., Snowling, M. J., & Scanlon, D. M . (2004). Specific reading disability (dyslexia): What have we learned in the past four decades? Journal of Child Psychology and Psychiatry, 45(1), 2-40.
[72]	Wauters, L. N., van Bon,, W. H. J., Tellings, A. E. J. M . (2006). Reading comprehension of Dutch deaf children. Reading and Writing, 19(1), 49-76. doi: 10.1007/s11145-004-5894-0 URL