The cognitive mechanism of haptic recognition of two-dimension images

doi:10.3724/SP.J.1042.2019.00611

Abstract

Abstract:

The two-dimension tactile image is the main approach of translating visual information into haptic information. It plays an important role in helping visually impaired people perceive the external world. The recognition of haptic two-dimension image is considered to be based on the “visual translation” process where the haptic input is translated into the visual image. This process is influenced by the graphic geometric feature, perspective, visual experience, capability of visual representation, the process of tactile exploration, training and age. Exploration of the cognitive neural mechanism of two-dimension images haptic recognition is significant for improving the design and usability of two-dimension tactile images.

Key words: two-dimension tactile images, touch, haptic perception, visually impaired people

CLC Number:

B842

YU Wenyuan, LIU Ye, FU Xiaolan, GONG Jiangtao, XU Yingqing. The cognitive mechanism of haptic recognition of two-dimension images[J]. Advances in Psychological Science, 2019, 27(4): 611-622.

References 77

[1]	谌小猛, 李闻戈 . ( 2016). 触觉地图辅助盲人建构陌生环境空间表征的研究. 中国特殊教育, (9), 36-42.
[2]	龚江涛, 於文苑, 曲同, 刘烨, 傅小兰, 徐迎庆 . ( 2018). 影响触觉图像识别因素的量化分析. 计算机辅助设计与图形学学报, 30, (8), 1438-1445.
[3]	焦阳, 龚江涛, 史元春, 徐迎庆 . ( 2016). 盲人触觉图形显示器的交互体验研究. 计算机辅助设计与图形学学报, 28, (9), 1571-1576. doi: 10.3969/j.issn.1003-9775.2016.09.021 URL
[4]	焦阳, 龚江涛, 徐迎庆 . ( 2016). 盲人触觉图像显示器Graille设计研究. 装饰, (1), 94-96.
[5]	杨光, 钟经华, 董晶 . ( 2017). 浅谈视障教学中触觉图形的认知. 现代特殊教育, (23), 59-61.
[6]	张蕾, 刘建英 . ( 2014). 盲校地理课程触觉地图的开发与应用研究. 中国特殊教育, (3), 24-29. doi: 10.3969/j.issn.1007-3728.2014.03.004 URL
[7]	周丽丽, 姚欣茹, 汤征宇, 任巧悦, 吕雪靖, 胡理 . ( 2017). 触觉信息处理及其脑机制. 科技导报, 35, (19), 37-43.
[8]	Amedi A., Jacobson G., Hendler T., Malach R., & Zohary E . ( 2002). Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex, 12, (11), 1202-1212. doi: 10.1093/cercor/12.11.1202 URL pmid: 12379608
[9]	Barros P., Maciel-Junior N. T., Fernandes B. J. T., Bezerra B. L. D., & Fernandes S. M. M . ( 2017). A dynamic gesture recognition and prediction system using the convexity approach. Computer Vision and Image Understanding, 155, 139-149. doi: 10.1016/j.cviu.2016.10.006 URL
[10]	Bauer C., Yazzolino L., Hirsch G., Cattaneo Z., Vecchi T., & Merabet L. B . ( 2015). Neural correlates associated with superior tactile symmetry perception in the early blind. Cortex, 63, 104-117. doi: 10.1016/j.cortex.2014.08.003 URL pmid: 25243993
[11]	Baumgartner E., Wiebel C. B., & Gegenfurtner K. R . ( 2015). A comparison of haptic material perception in blind and sighted individuals. Vision Research, 115, 238-245. doi: 10.1016/j.visres.2015.02.006 URL pmid: 25711976
[12]	Behrmann M., &Ewell C. ( 2003). Expertise in tactile pattern recognition. Psychological Science, 14, (5), 480-486. doi: 10.1111/1467-9280.02458 URL pmid: 12930480
[13]	Bellik Y., &Clavel C. ( 2017). Geometrical shapes rendering on a dot-matrix display. International Conference on Intelligent Human Computer Interaction( pp. 8-18). Springer, Cham. doi: 10.1007/978-3-319-72038-8_2 URL
[14]	Bouaziz S., Russier S., & Magnan A . ( 2005). The copying of complex geometric drawings by sighted and visually impaired children. Journal of Visual Impairment & Blindness, 99, (12), 765-774. doi: 10.1044/1092-4388(2005/106) URL
[15]	Brock A. M., Truillet P., Oriola B., Picard D., & Jouffrais C . ( 2015). Interactivity improves usability of geographic maps for visually impaired people. Human-Computer Interaction, 30, (2), 156-194. doi: 10.1080/07370024.2014.924412 URL
[16]	Cattaneo Z., Vecchi T., Cornoldi C., Mammarella I., Bonino D., Ricciardi E., & Pietrini P . ( 2008). Imagery and spatial processes in blindness and visual impairment. Neuroscience and Biobehavioral Reviews, 32, (8), 1346-1360. doi: 10.1016/j.neubiorev.2008.05.002 URL pmid: 18571726
[17]	Cattaneo Z., Vecchi T., Monegato M., Pece A., & Cornoldi C . ( 2007). Effects of late visual impairment on mental representations activated by visual and tactile stimuli. Brain Research, 1148, 170-176. doi: 10.1016/j.brainres.2007.02.033 URL pmid: 17368576
[18]	Cecchetto S., &Lawson R. ( 2017). Regularity detection by haptics and vision. Journal of Experimental Psychology Human Perception & Performance, 43, (1), 103. doi: 10.1037/xhp0000283 URL pmid: 27808551
[19]	Chang D., Nesbitt K. V., & Wilkins K . ( 2007). The Gestalt principles of similarity and proximity apply to both the haptic and visual grouping of elements. Paper presented at the Eight Australasian User Interface Conference (AUIC2007), Ballarat, Australia.
[20]	Cornoldi C., Tinti C., Mammarella I. C., Re A. M., & Varotto D . ( 2009). Memory for an imagined pathway and strategy effects in sighted and in totally congenitally blind individuals. Acta Psychologica, 130, (1), 11-16. doi: 10.1016/j.actpsy.2008.09.012 URL pmid: 19013547
[21]	Gallace A., &Spence C. ( 2011). To what extent do gestalt grouping principles influence tactile perception? Psychological Bulletin, 137, (4), 538-561. doi: 10.1037/a0022335 URL pmid: 21574680
[22]	Grunwald M., Muniyandi M., Kim H., Kim J., Krause F., Mueller S., & Srinivasan M. A . ( 2014). Human haptic perception is interrupted by explorative stops of milliseconds. Front Psychol, 5, (4), 292. doi: 10.3389/fpsyg.2014.00292 URL pmid: 3988394
[23]	Gual J., Puyuelo M., & Lloveras J . ( 2015). The effect of volumetric (3D) tactile symbols within inclusive tactile maps. Applied Ergonomics, 48, 1-10. doi: 10.1016/j.apergo.2014.10.018 URL pmid: 25683526
[24]	Hatwell Y., Streri A., & Gentaz E . ( 2003). Touching for knowing: Cognitive psychology of haptic manual perception, John Benjamins Pub.
[25]	Heller M. A., Brackett D. D., Scroggs E., Steffen H., Heatherly K., & Salik S . ( 2002). Tangible pictures: Viewpoint effects and linear perspective in visually impaired people. Perception, 31, (6), 747-769. doi: 10.1068/p3253 URL pmid: 12092800
[26]	Heller M. A., Kennedy J. M., Clark A., McCarthy M., Borgert A., Wemple L., .. Riddle T . ( 2006). Viewpoint and orientation influence picture recognition in the blind. Perception, 35, (10), 1397-1420. doi: 10.1068/p5460 URL pmid: 17214384
[27]	Heller M. A., McCarthy M., & Clark A . ( 2005). Pattern perception and pictures for the blind. Psicologica, 26, (1), 161-171.
[28]	Heller M. A., Riddle T., Fulkerson E., Wemple L., Walk A. M., Guthrie S., .. Klaus P . ( 2009). The influence of viewpoint and object detail in blind people when matching pictures to complex objects. Perception, 38, (8), 1234-1250. doi: 10.1068/p5596 URL pmid: 19817155
[29]	Kaas A. L., van Mier H., Visser M., & Goebel R . ( 2013). The neural substrate for working memory of tactile surface texture. Human Brain Mapping, 34, (5), 1148-1162. doi: 10.1002/hbm.21500 URL pmid: 22576840
[30]	Kalia A., Hopkins R., Jin D., Yazzolino L., Verma S., Merabet L., .. Sinha P . ( 2014). Perception of tactile graphics: Embossings versus cutouts. Multisensory Research, 27, (2), 111-125. doi: 10.1163/22134808-00002450 URL pmid: 25296474
[31]	Kalia A.A., &Sinha P. ( 2012). Tactile Picture Recognition: Errors are in shape acquisition or object matching? Seeing and Perceiving, 25, (3-4), 287-302. doi: 10.1163/187847511x584443 URL pmid: 21871145
[32]	Kappers A. M.L., &Tiest W. M.B . ( 2013). Haptic perception. Wiley Interdisciplinary Reviews-Cognitive Science, 4, (4), 357-374.
[33]	Kennedy J.M., &Juricevic I. ( 2006). Foreshortening, convergence and drawings from a blind adult. Perception, 35, (6), 847-851. doi: 10.1068/p5316 URL pmid: 16836049
[34]	Klatzky R.L., &Lederman S.J . ( 1988). The intelligent hand. Psychology of Learning & Motivation, 21, 121-151.
[35]	Ku Y., Zhao D., Bodner M., & Zhou Y-D . ( 2015). Cooperative processing in primary somatosensory cortex and posterior parietal cortex during tactile working memory. European Journal of Neuroscience, 42, (3), 1905-1911. doi: 10.1111/ejn.12950 URL pmid: 25980785
[36]	Lacey S., &Lawson R. ( 2013). Multisensory Imagery. Springer.
[37]	Lacey S., &Sathian K. ( 2014). Visuo-haptic multisensory object recognition, categorization, and representation. Frontiers in Psychology, 5.
[38]	Lacey S., Stilla R., Sreenivasan K., Deshpande G., & Sathian K . ( 2014). Spatial imagery in haptic shape perception. Neuropsychologia, 60, 144-158. doi: 10.1007/978-1-4614-5879-1_11 URL pmid: 4122331
[39]	Lebaz S., Jouffrais C., & Picard D . ( 2012). Haptic identification of raised-line drawings: High visuospatial imagers outperform low visuospatial imagers. Psychological Research-Psychologische Forschung, 76, (5), 667-675. doi: 10.1007/s00426-011-0351-6 URL pmid: 21695471
[40]	Lebaz S., Picard D., & Jouffrais C . ( 2010). Haptic recognition of non-figurative tactile pictures in the blind: Does life-time proportion without visual experience matter? Haptics: Generating and Perceiving Tangible Sensations, Pt Ii, Proceedings, 65, (5), 412-417. doi: 10.1007/978-3-642-14075-4_61 URL
[41]	Lederman S. J., Klatzky R. L., Chataway C., & Summers C. D . ( 1990). Visual mediation and the haptic recognition of 2-dimensional pictures of common objects. Perception & Psychophysics, 47, (1), 54-64. doi: 10.3758/BF03208164 URL pmid: 2300424
[42]	Longo M.R., &Golubova O. ( 2017). Mapping the internal geometry of tactile space. Journal of Experimental Psychology-Human Perception and Performance, 43, (10), 1815-1827. doi: 10.1037/xhp0000434 pmid: 28967785
[43]	Loomis J. M., Klatzky R. L., & Lederman S. J . ( 1991). Similarity of tactual and visual picture recognition with limited field of view. Perception, 20, (2), 167-177. doi: 10.1068/p200167 URL pmid: 1745589
[44]	Mazella A., Albaret J. M., & Picard D . ( 2014). Haptic tests for use with children and adults with visual impairments: A literature review. Journal of Visual Impairment & Blindness, 108, (108), 227-237.
[45]	Mazella A., Albaret J-M., & Picard D . ( 2016). Haptic-2D: A new haptic test battery assessing the tactual abilities of sighted and visually impaired children and adolescents with two-dimensional raised materials. Research in Developmental Disabilities, 48, 103-123. doi: 10.1016/j.ridd.2015.10.012 URL pmid: 26551596
[46]	Mazella A., Albaret J-M., & Picard D . ( 2018). The development of haptic processing skills from childhood to adulthood by means of two-dimensional materials. Canadian Journal of Experimental Psychology-Revue Canadienne De Psychologie Experimentale, 72, (1), 48-57. doi: 10.1037/cep0000121 URL
[47]	Memeo M., Campus C., & Brayda L . ( 2014). Do blind subjects differ from sighted subjects when exploring virtual tactile maps? Computers Helping People with Special Needs, Icchp 2014, 8548, 12-17. doi: 10.1007/978-3-319-08599-9 URL
[48]	Morash V. S., Pensky A. E. C., Tseng S. T. W., & Miele J. A . ( 2014). Effects of using multiple hands and fingers on haptic performance in individuals who are blind. Perception, 43, (6), 569-588. doi: 10.1068/p7712 URL
[49]	Overvliet K.E., &Krampe R.T . ( 2018). Haptic two-dimensional shape identification in children, adolescents, and young adults. Journal of Experimental Child Psychology, 166, 567-580. doi: 10.1016/j.jecp.2017.09.024 URL
[50]	Overvliet K. E., Krampe R. T., & Wagemans J . ( 2012). Perceptual grouping in haptic search: The influence of proximity, similarity, and good continuation. Journal of Experimental Psychology-Human Perception and Performance, 38, (4), 817-821. doi: 10.1037/a0029222 pmid: 22774798
[51]	Overvliet K. E., Wagemans J., & Krampe R. T . ( 2013). The effects of aging on haptic 2D shape recognition. Psychology and Aging, 28, (4), 1057-1069. doi: 10.1037/a0033415 URL pmid: 23978010
[52]	Pawluk D. T., Adams R. J., & Kitada R . ( 2015). Designing haptic assistive technology for individuals who are blind or visually impaired. Ieee Transactions on Haptics, 8, (3), 258-278. doi: 10.1109/TOH.2015.2471300 pmid: 26336151
[53]	Picard D., Albaret J. M., & Mazella A . ( 2013). Haptic identification of raised-line drawings by children, adolescents and young adults. Haptics-e, 5, (2), 24-28.
[54]	Picard D., Albaret J-M., & Mazella A . ( 2014). Haptic identification of raised-line drawings when categorical information is given: A comparison between visually impaired and sighted children. Psicologica, 35, (2), 277-290. doi: 10.1006/jcht.1994.1043 URL
[55]	Picard D., Lebaz S., Jouffrais C., & Monnier C . ( 2010). Haptic recognition of two-dimensional raised-line patterns by early-blind, late-blind, and blindfolded sighted adults. Perception, 39, (2), 224-235. doi: 10.1068/p6527 URL pmid: 20402244
[56]	Picard D., &Monnier C. ( 2009). Short-term memory for spatial configurations in the tactile modality: A comparison with vision. Memory, 17, (8), 789-801. doi: 10.1080/09658210903107838 URL pmid: 19606379
[57]	Rastogi R., Pawluk T. V. D., & Ketchum J . ( 2013). Intuitive tactile zooming for graphics accessed by individuals who are blind and visually impaired. Ieee Transactions on Neural Systems and Rehabilitation Engineering, 21, (4), 655-663. doi: 10.1109/TNSRE.2013.2250520 URL pmid: 23529106
[58]	Saal H.P., &Bensmaia S.J . ( 2014). Touch is a team effort: Interplay of submodalities in cutaneous sensibility. Trends in Neurosciences, 37, (12), 689-697. doi: 10.1016/j.tins.2014.08.012 URL pmid: 25257208
[59]	Sathian K . ( 2016). Analysis of haptic information in the cerebral cortex. Journal of Neurophysiology, 116, (4), 1795-1806. doi: 10.1152/jn.00546.2015 URL pmid: 27440247
[60]	Segond H., Weiss D., Kawalec M., & Sampaio E . ( 2013). Perceiving space and optical cues via a visuo-tactile sensory substitution system: A methodological approach for training of blind subjects for navigation. Perception, 42, (5), 508-528. doi: 10.1068/p6339 URL pmid: 23964377
[61]	Snow J. C., Goodale M. A., & Culham J. C . ( 2015). Preserved haptic shape processing after bilateral LOC lesions. Journal of Neuroscience, 35, (40), 13745-13760. doi: 10.1523/JNEUROSCI.0859-14.2015 URL pmid: 26446226
[62]	Stilla R., &Sathian K. ( 2008). Selective visuo-haptic processing of shape and texture. Human Brain Mapping, 29, (10), 1123-1138.
[63]	Symmons M., &Richardson B. ( 2000). Raised line drawings are spontaneously explored with a single finger. Perception, 29, (5), 621-626. doi: 10.1068/p2964 URL pmid: 10992958
[64]	Theurel A., Witt A., Claudet P., Hatwell Y., & Gentaz E . ( 2013). Tactile picture recognition by early blind children: The effect of illustration technique. Journal of Experimental Psychology-Applied, 19, (3), 233-240. doi: 10.1037/a0034255 URL pmid: 24059824
[65]	Toderita I., Bourgeon S., Voisin J. I. A., & Chapman C. E . ( 2014). Haptic two-dimensional angle categorization and discrimination. Experimental Brain Research, 232, (2), 369-383. doi: 10.1007/s00221-013-3745-4 URL pmid: 24170289
[66]	Trief E., Cascella P. W., & Bruce S. M . ( 2013). A field study of a standardized tangible symbol system for learners who are visually impaired and have multiple disabilities. Journal of Visual Impairment & Blindness, 107, (3), 180-191.
[67]	Van Aarsen V., &Overvliet K.E . ( 2016). Perceptual grouping by similarity of surface roughness in haptics: The influence of task difficulty. Experimental Brain Research, 234, (8), 2227-2234. doi: 10.1007/s00221-016-4628-2 URL pmid: 27010724
[68]	Vidal-Verdu F., &Hafez M. ( 2007). Graphical tactile displays for visually-impaired people. IEEE Transactions on Neural Systems & Rehabilitation Engineering, 15, (1), 119-130. doi: 10.1109/TNSRE.2007.891375 URL pmid: 17436884
[69]	Vinter A., Fernandes V., Orlandi O., & Morgan P . ( 2012). Exploratory procedures of tactile images in visually impaired and blindfolded sighted children: How they relate to their consequent performance in drawing. Research in Developmental Disabilities, 33, (6), 1819-1831. doi: 10.1016/j.ridd.2012.05.001 URL pmid: 22699255
[70]	Wijntjes M. W.A., &Kappers A. M.L . ( 2007). Angle discrimination in raised-line drawings. Perception, 36, (6), 865-879. doi: 10.1068/p5603 URL pmid: 17718365
[71]	Wijntjes M. W. A., van Lienen T., Verstijnen I. M & Kappers A. M. L., . ( 2008). The influence of picture size on recognition and exploratory behaviour in raised-line drawings. Perception, 37, (4), 602-614. doi: 10.1068/p5714 URL pmid: 18546666
[72]	Wnuczko M., &Kennedy J.M . ( 2014). Pointing to azimuths and elevations of targets: Blind and blindfolded- sighted. Perception, 43, (2-3), 117-128. doi: 10.1068/p7605 URL pmid: 24919348
[73]	Yang J., Kitada R., Kochiyama T., Yu Y., Kai M., Araki Y., .. Sadato N . ( 2017). Brain networks involved in tactile speed classification of moving dot patterns: The effects of speed and dot periodicity. Scientific Reports, 7, 40931). doi: 10.1038/srep40931 URL pmid: 5286508
[74]	Yang J., Yu Y., Kunita A., Qiang H., Wu J., Sawamoto N., & Fukuyama H . ( 2014). Tactile priming modulates the activation of the fronto-parietal circuit during tactile angle match and non-match processing: An fMRI study. Frontiers in Human Neuroscience, 8, (926), 926. doi: 10.3389/fnhum.2014.00926 URL pmid: 25566010
[75]	Yau J. M., Kim S. S., Thakur P. H., & Bensmaia S. J . ( 2016). Feeling form: the neural basis of haptic shape perception. Journal of Neurophysiology, 115, (2), 631-642. doi: 10.1152/jn.00598.2015 URL pmid: 26581869
[76]	Yoshida T., Yamaguchi A., Tsutsui H., & Wake T . ( 2015). Tactile search for change has less memory than visual search for change. Attention Perception & Psychophysics, 77, (4), 1200-1211. doi: 10.3758/s13414-014-0829-6 URL pmid: 25724516
[77]	Yu J., Wu Q., Yang J., Takahashi S., Ejima Y., & Wu J . ( 2017). A study of shape discrimination for tactile guide maps. IEEE International Conference on Mechatronics and Automation( pp.565-570). IEEE. doi: 10.1109/ICMA.2017.8015879 URL