Please wait a minute...
Advances in Psychological Science    2019, Vol. 27 Issue (4) : 611-622     DOI: 10.3724/SP.J.1042.2019.00611
Regular Articles |
The cognitive mechanism of haptic recognition of two-dimension images
YU Wenyuan1,2,LIU Ye1,2(),FU Xiaolan1,2,GONG Jiangtao3,4,XU Yingqing3,4()
1 State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China
2 Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
3 Department of Information Art and Design, Academy of Arts and Design, Tsinghua University, Beijing 100084, China
4 The Future Lab, Tsinghua University Beijing 100084, China
Download: PDF(616 KB)   HTML
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks     Supporting Info
Guide   
Abstract  

The two-dimension tactile image is the main approach of translating visual information into haptic information. It plays an important role in helping visually impaired people perceive the external world. The recognition of haptic two-dimension image is considered to be based on the “visual translation” process where the haptic input is translated into the visual image. This process is influenced by the graphic geometric feature, perspective, visual experience, capability of visual representation, the process of tactile exploration, training and age. Exploration of the cognitive neural mechanism of two-dimension images haptic recognition is significant for improving the design and usability of two-dimension tactile images.

Keywords two-dimension tactile images      touch      haptic perception      visually impaired people     
ZTFLH:  B842  
Corresponding Authors: Ye LIU,Yingqing XU     E-mail: liuye@psych.ac.cn;yqxu@mail.tsinghua.edu.cn
Issue Date: 22 February 2019
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
Wenyuan YU
Ye LIU
Xiaolan FU
Jiangtao GONG
Yingqing XU
Cite this article:   
Wenyuan YU,Ye LIU,Xiaolan FU, et al. The cognitive mechanism of haptic recognition of two-dimension images[J]. Advances in Psychological Science, 2019, 27(4): 611-622.
URL:  
http://journal.psych.ac.cn/xlkxjz/EN/10.3724/SP.J.1042.2019.00611     OR     http://journal.psych.ac.cn/xlkxjz/EN/Y2019/V27/I4/611
[1] 谌小猛, 李闻戈 . ( 2016). 触觉地图辅助盲人建构陌生环境空间表征的研究. 中国特殊教育, (9), 36-42.
url: http://d.wanfangdata.com.cn/Periodical/zgtsjy201609006
[2] 龚江涛, 於文苑, 曲同, 刘烨, 傅小兰, 徐迎庆 . ( 2018). 影响触觉图像识别因素的量化分析. 计算机辅助设计与图形学学报, 30, (8), 1438-1445.
url: 研究点分析
[3] 焦阳, 龚江涛, 史元春, 徐迎庆 . ( 2016). 盲人触觉图形显示器的交互体验研究. 计算机辅助设计与图形学学报, 28, (9), 1571-1576.
url: http://www.cnki.com.cn/Article/CJFDTotal-JSJF201609021.htm
[4] 焦阳, 龚江涛, 徐迎庆 . ( 2016). 盲人触觉图像显示器Graille设计研究. 装饰, (1), 94-96.
url: http://www.cqvip.com/QK/96278X/201601/667777624.html
[5] 杨光, 钟经华, 董晶 . ( 2017). 浅谈视障教学中触觉图形的认知. 现代特殊教育, (23), 59-61.
url: http://www.cqvip.com/QK/80616X/201723/674107327.html
[6] 张蕾, 刘建英 . ( 2014). 盲校地理课程触觉地图的开发与应用研究. 中国特殊教育, (3), 24-29.
url: http://d.wanfangdata.com.cn/Periodical/zgtsjy201403004
[7] 周丽丽, 姚欣茹, 汤征宇, 任巧悦, 吕雪靖, 胡理 . ( 2017). 触觉信息处理及其脑机制. 科技导报, 35, (19), 37-43.
url: http://www.cqvip.com/QK/90455X/201719/673539170.html
[8] Amedi A., Jacobson G., Hendler T., Malach R., & Zohary E . ( 2002). Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex, 12, (11), 1202-1212.
pmid: 12379608 url: http://www.ncbi.nlm.nih.gov/pubmed/12379608
[9] Barros P., Maciel-Junior N. T., Fernandes B. J. T., Bezerra B. L. D., & Fernandes S. M. M . ( 2017). A dynamic gesture recognition and prediction system using the convexity approach. Computer Vision and Image Understanding, 155, 139-149.
url: https://linkinghub.elsevier.com/retrieve/pii/S107731421630159X
[10] Bauer C., Yazzolino L., Hirsch G., Cattaneo Z., Vecchi T., & Merabet L. B . ( 2015). Neural correlates associated with superior tactile symmetry perception in the early blind. Cortex, 63, 104-117.
pmid: 25243993 url: https://linkinghub.elsevier.com/retrieve/pii/S0010945214002561
[11] Baumgartner E., Wiebel C. B., & Gegenfurtner K. R . ( 2015). A comparison of haptic material perception in blind and sighted individuals. Vision Research, 115, 238-245.
pmid: 25711976 url: https://linkinghub.elsevier.com/retrieve/pii/S0042698915000474
[12] Behrmann M., &Ewell C. ( 2003). Expertise in tactile pattern recognition. Psychological Science, 14, (5), 480-486.
pmid: 12930480 url: http://www.ncbi.nlm.nih.gov/pubmed/12930480
[13] Bellik Y., &Clavel C. ( 2017). Geometrical shapes rendering on a dot-matrix display. International Conference on Intelligent Human Computer Interaction( pp. 8-18). Springer, Cham.
url: http://link.springer.com/chapter/10.1007/978-3-319-72038-8_2
[14] Bouaziz S., Russier S., & Magnan A . ( 2005). The copying of complex geometric drawings by sighted and visually impaired children. Journal of Visual Impairment & Blindness, 99, (12), 765-774.
url: http://eric.ed.gov/?id=EJ722377
[15] Brock A. M., Truillet P., Oriola B., Picard D., & Jouffrais C . ( 2015). Interactivity improves usability of geographic maps for visually impaired people. Human-Computer Interaction, 30, (2), 156-194.
url: http://www.tandfonline.com/doi/abs/10.1080/07370024.2014.924412
[16] Cattaneo Z., Vecchi T., Cornoldi C., Mammarella I., Bonino D., Ricciardi E., & Pietrini P . ( 2008). Imagery and spatial processes in blindness and visual impairment. Neuroscience and Biobehavioral Reviews, 32, (8), 1346-1360.
pmid: 18571726 url: http://europepmc.org/abstract/MED/18571726
[17] Cattaneo Z., Vecchi T., Monegato M., Pece A., & Cornoldi C . ( 2007). Effects of late visual impairment on mental representations activated by visual and tactile stimuli. Brain Research, 1148, 170-176.
pmid: 17368576 url: https://linkinghub.elsevier.com/retrieve/pii/S0006899307004246
[18] Cecchetto S., &Lawson R. ( 2017). Regularity detection by haptics and vision. Journal of Experimental Psychology Human Perception & Performance, 43, (1), 103.
pmid: 27808551 url: http://www.ncbi.nlm.nih.gov/pubmed/27808551
[19] Chang D., Nesbitt K. V., & Wilkins K . ( 2007). The Gestalt principles of similarity and proximity apply to both the haptic and visual grouping of elements. Paper presented at the Eight Australasian User Interface Conference (AUIC2007), Ballarat, Australia.
[20] Cornoldi C., Tinti C., Mammarella I. C., Re A. M., & Varotto D . ( 2009). Memory for an imagined pathway and strategy effects in sighted and in totally congenitally blind individuals. Acta Psychologica, 130, (1), 11-16.
pmid: 19013547 url: http://www.ncbi.nlm.nih.gov/pubmed/19013547
[21] Gallace A., &Spence C. ( 2011). To what extent do gestalt grouping principles influence tactile perception? Psychological Bulletin, 137, (4), 538-561.
pmid: 21574680 url: http://www.ncbi.nlm.nih.gov/pubmed/21574680
[22] Grunwald M., Muniyandi M., Kim H., Kim J., Krause F., Mueller S., & Srinivasan M. A . ( 2014). Human haptic perception is interrupted by explorative stops of milliseconds. Front Psychol, 5, (4), 292.
pmid: 3988394 url: http://www.ncbi.nlm.nih.gov/pubmed/24782797
[23] Gual J., Puyuelo M., & Lloveras J . ( 2015). The effect of volumetric (3D) tactile symbols within inclusive tactile maps. Applied Ergonomics, 48, 1-10.
pmid: 25683526 url: https://linkinghub.elsevier.com/retrieve/pii/S0003687014002142
[24] Hatwell Y., Streri A., & Gentaz E . ( 2003). Touching for knowing: Cognitive psychology of haptic manual perception, John Benjamins Pub.
[25] Heller M. A., Brackett D. D., Scroggs E., Steffen H., Heatherly K., & Salik S . ( 2002). Tangible pictures: Viewpoint effects and linear perspective in visually impaired people. Perception, 31, (6), 747-769.
pmid: 12092800 url: http://www.ncbi.nlm.nih.gov/pubmed/12092800
[26] Heller M. A., Kennedy J. M., Clark A., McCarthy M., Borgert A., Wemple L., .. Riddle T . ( 2006). Viewpoint and orientation influence picture recognition in the blind. Perception, 35, (10), 1397-1420.
pmid: 17214384 url: http://www.ncbi.nlm.nih.gov/pubmed/17214384
[27] Heller M. A., McCarthy M., & Clark A . ( 2005). Pattern perception and pictures for the blind. Psicologica, 26, (1), 161-171.
[28] Heller M. A., Riddle T., Fulkerson E., Wemple L., Walk A. M., Guthrie S., .. Klaus P . ( 2009). The influence of viewpoint and object detail in blind people when matching pictures to complex objects. Perception, 38, (8), 1234-1250.
pmid: 19817155 url: http://europepmc.org/abstract/MED/19817155
[29] Kaas A. L., van Mier H., Visser M., & Goebel R . ( 2013). The neural substrate for working memory of tactile surface texture. Human Brain Mapping, 34, (5), 1148-1162.
pmid: 22576840 url: http://onlinelibrary.wiley.com/doi/10.1002/hbm.21500/full
[30] Kalia A., Hopkins R., Jin D., Yazzolino L., Verma S., Merabet L., .. Sinha P . ( 2014). Perception of tactile graphics: Embossings versus cutouts. Multisensory Research, 27, (2), 111-125.
pmid: 25296474 url: http://europepmc.org/abstract/med/25296474
[31] Kalia A.A., &Sinha P. ( 2012). Tactile Picture Recognition: Errors are in shape acquisition or object matching? Seeing and Perceiving, 25, (3-4), 287-302.
pmid: 21871145 url: http://test.europepmc.org/abstract/MED/21871145
[32] Kappers A. M.L., &Tiest W. M.B . ( 2013). Haptic perception. Wiley Interdisciplinary Reviews-Cognitive Science, 4, (4), 357-374.
[33] Kennedy J.M., &Juricevic I. ( 2006). Foreshortening, convergence and drawings from a blind adult. Perception, 35, (6), 847-851.
pmid: 16836049 url: http://www.ncbi.nlm.nih.gov/pubmed/16836049
[34] Klatzky R.L., &Lederman S.J . ( 1988). The intelligent hand. Psychology of Learning & Motivation, 21, 121-151.
[35] Ku Y., Zhao D., Bodner M., & Zhou Y-D . ( 2015). Cooperative processing in primary somatosensory cortex and posterior parietal cortex during tactile working memory. European Journal of Neuroscience, 42, (3), 1905-1911.
pmid: 25980785 url: http://www.ncbi.nlm.nih.gov/pubmed/25980785
[36] Lacey S., &Lawson R. ( 2013). Multisensory Imagery. Springer.
[37] Lacey S., &Sathian K. ( 2014). Visuo-haptic multisensory object recognition, categorization, and representation. Frontiers in Psychology, 5.
[38] Lacey S., Stilla R., Sreenivasan K., Deshpande G., & Sathian K . ( 2014). Spatial imagery in haptic shape perception. Neuropsychologia, 60, 144-158.
pmid: 4122331 url: https://linkinghub.elsevier.com/retrieve/pii/S0028393214001560
[39] Lebaz S., Jouffrais C., & Picard D . ( 2012). Haptic identification of raised-line drawings: High visuospatial imagers outperform low visuospatial imagers. Psychological Research-Psychologische Forschung, 76, (5), 667-675.
pmid: 21695471 url: http://link.springer.com/article/10.1007/s00426-011-0351-6
[40] Lebaz S., Picard D., & Jouffrais C . ( 2010). Haptic recognition of non-figurative tactile pictures in the blind: Does life-time proportion without visual experience matter? Haptics: Generating and Perceiving Tangible Sensations, Pt Ii, Proceedings, 65, (5), 412-417.
url: http://dl.acm.org/citation.cfm?id=1893825
[41] Lederman S. J., Klatzky R. L., Chataway C., & Summers C. D . ( 1990). Visual mediation and the haptic recognition of 2-dimensional pictures of common objects. Perception & Psychophysics, 47, (1), 54-64.
pmid: 2300424 url: http://www.ncbi.nlm.nih.gov/pubmed/2300424
[42] Longo M.R., &Golubova O. ( 2017). Mapping the internal geometry of tactile space. Journal of Experimental Psychology-Human Perception and Performance, 43, (10), 1815-1827.
pmid: 28967785
[43] Loomis J. M., Klatzky R. L., & Lederman S. J . ( 1991). Similarity of tactual and visual picture recognition with limited field of view. Perception, 20, (2), 167-177.
pmid: 1745589 url: http://europepmc.org/abstract/MED/1745589
[44] Mazella A., Albaret J. M., & Picard D . ( 2014). Haptic tests for use with children and adults with visual impairments: A literature review. Journal of Visual Impairment & Blindness, 108, (108), 227-237.
[45] Mazella A., Albaret J-M., & Picard D . ( 2016). Haptic-2D: A new haptic test battery assessing the tactual abilities of sighted and visually impaired children and adolescents with two-dimensional raised materials. Research in Developmental Disabilities, 48, 103-123.
pmid: 26551596 url: https://linkinghub.elsevier.com/retrieve/pii/S0891422215001833
[46] Mazella A., Albaret J-M., & Picard D . ( 2018). The development of haptic processing skills from childhood to adulthood by means of two-dimensional materials. Canadian Journal of Experimental Psychology-Revue Canadienne De Psychologie Experimentale, 72, (1), 48-57.
url: http://psycnet.apa.org/record/2017-15692-001
[47] Memeo M., Campus C., & Brayda L . ( 2014). Do blind subjects differ from sighted subjects when exploring virtual tactile maps? Computers Helping People with Special Needs, Icchp 2014, 8548, 12-17.
url: http://link.springer.com/10.1007/978-3-319-08599-9
[48] Morash V. S., Pensky A. E. C., Tseng S. T. W., & Miele J. A . ( 2014). Effects of using multiple hands and fingers on haptic performance in individuals who are blind. Perception, 43, (6), 569-588.
url: http://www.onacademic.com/detail/journal_1000038641579710_334c.html
[49] Overvliet K.E., &Krampe R.T . ( 2018). Haptic two-dimensional shape identification in children, adolescents, and young adults. Journal of Experimental Child Psychology, 166, 567-580.
url: https://linkinghub.elsevier.com/retrieve/pii/S0022096516302727
[50] Overvliet K. E., Krampe R. T., & Wagemans J . ( 2012). Perceptual grouping in haptic search: The influence of proximity, similarity, and good continuation. Journal of Experimental Psychology-Human Perception and Performance, 38, (4), 817-821.
pmid: 22774798
[51] Overvliet K. E., Wagemans J., & Krampe R. T . ( 2013). The effects of aging on haptic 2D shape recognition. Psychology and Aging, 28, (4), 1057-1069.
pmid: 23978010 url: http://www.ncbi.nlm.nih.gov/pubmed/23978010
[52] Pawluk D. T., Adams R. J., & Kitada R . ( 2015). Designing haptic assistive technology for individuals who are blind or visually impaired. Ieee Transactions on Haptics, 8, (3), 258-278.
pmid: 26336151
[53] Picard D., Albaret J. M., & Mazella A . ( 2013). Haptic identification of raised-line drawings by children, adolescents and young adults. Haptics-e, 5, (2), 24-28.
[54] Picard D., Albaret J-M., & Mazella A . ( 2014). Haptic identification of raised-line drawings when categorical information is given: A comparison between visually impaired and sighted children. Psicologica, 35, (2), 277-290.
url: http://eric.ed.gov/?id=EJ1046021
[55] Picard D., Lebaz S., Jouffrais C., & Monnier C . ( 2010). Haptic recognition of two-dimensional raised-line patterns by early-blind, late-blind, and blindfolded sighted adults. Perception, 39, (2), 224-235.
pmid: 20402244 url: http://www.ncbi.nlm.nih.gov/pubmed/20402244
[56] Picard D., &Monnier C. ( 2009). Short-term memory for spatial configurations in the tactile modality: A comparison with vision. Memory, 17, (8), 789-801.
pmid: 19606379 url: http://www.ncbi.nlm.nih.gov/pubmed/19606379
[57] Rastogi R., Pawluk T. V. D., & Ketchum J . ( 2013). Intuitive tactile zooming for graphics accessed by individuals who are blind and visually impaired. Ieee Transactions on Neural Systems and Rehabilitation Engineering, 21, (4), 655-663.
pmid: 23529106 url: http://europepmc.org/abstract/med/23529106
[58] Saal H.P., &Bensmaia S.J . ( 2014). Touch is a team effort: Interplay of submodalities in cutaneous sensibility. Trends in Neurosciences, 37, (12), 689-697.
pmid: 25257208 url: http://www.ncbi.nlm.nih.gov/pubmed/25257208
[59] Sathian K . ( 2016). Analysis of haptic information in the cerebral cortex. Journal of Neurophysiology, 116, (4), 1795-1806.
pmid: 27440247 url: http://www.ncbi.nlm.nih.gov/pubmed/27440247
[60] Segond H., Weiss D., Kawalec M., & Sampaio E . ( 2013). Perceiving space and optical cues via a visuo-tactile sensory substitution system: A methodological approach for training of blind subjects for navigation. Perception, 42, (5), 508-528.
pmid: 23964377 url: http://www.ncbi.nlm.nih.gov/pubmed/23964377
[61] Snow J. C., Goodale M. A., & Culham J. C . ( 2015). Preserved haptic shape processing after bilateral LOC lesions. Journal of Neuroscience, 35, (40), 13745-13760.
pmid: 26446226 url: http://www.ncbi.nlm.nih.gov/pubmed/26446226
[62] Stilla R., &Sathian K. ( 2008). Selective visuo-haptic processing of shape and texture. Human Brain Mapping, 29, (10), 1123-1138.
[63] Symmons M., &Richardson B. ( 2000). Raised line drawings are spontaneously explored with a single finger. Perception, 29, (5), 621-626.
pmid: 10992958 url: http://europepmc.org/abstract/MED/10992958
[64] Theurel A., Witt A., Claudet P., Hatwell Y., & Gentaz E . ( 2013). Tactile picture recognition by early blind children: The effect of illustration technique. Journal of Experimental Psychology-Applied, 19, (3), 233-240.
pmid: 24059824 url: http://psycnet.apa.org/journals/xap/19/3/233/
[65] Toderita I., Bourgeon S., Voisin J. I. A., & Chapman C. E . ( 2014). Haptic two-dimensional angle categorization and discrimination. Experimental Brain Research, 232, (2), 369-383.
pmid: 24170289 url: http://www.ncbi.nlm.nih.gov/pubmed/24170289
[66] Trief E., Cascella P. W., & Bruce S. M . ( 2013). A field study of a standardized tangible symbol system for learners who are visually impaired and have multiple disabilities. Journal of Visual Impairment & Blindness, 107, (3), 180-191.
url: http://eric.ed.gov/?id=EJ1008210
[67] Van Aarsen V., &Overvliet K.E . ( 2016). Perceptual grouping by similarity of surface roughness in haptics: The influence of task difficulty. Experimental Brain Research, 234, (8), 2227-2234.
pmid: 27010724 url: http://europepmc.org/abstract/MED/27010724
[68] Vidal-Verdu F., &Hafez M. ( 2007). Graphical tactile displays for visually-impaired people. IEEE Transactions on Neural Systems & Rehabilitation Engineering, 15, (1), 119-130.
pmid: 17436884 url: http://www.ncbi.nlm.nih.gov/pubmed/17436884
[69] Vinter A., Fernandes V., Orlandi O., & Morgan P . ( 2012). Exploratory procedures of tactile images in visually impaired and blindfolded sighted children: How they relate to their consequent performance in drawing. Research in Developmental Disabilities, 33, (6), 1819-1831.
pmid: 22699255 url: http://test.europepmc.org/abstract/MED/22699255
[70] Wijntjes M. W.A., &Kappers A. M.L . ( 2007). Angle discrimination in raised-line drawings. Perception, 36, (6), 865-879.
pmid: 17718365 url: http://www.ncbi.nlm.nih.gov/pubmed/17718365
[71] Wijntjes M. W. A., van Lienen T., Verstijnen I. M & Kappers A. M. L., . ( 2008). The influence of picture size on recognition and exploratory behaviour in raised-line drawings. Perception, 37, (4), 602-614.
pmid: 18546666 url: http://www.ncbi.nlm.nih.gov/pubmed/18546666
[72] Wnuczko M., &Kennedy J.M . ( 2014). Pointing to azimuths and elevations of targets: Blind and blindfolded- sighted. Perception, 43, (2-3), 117-128.
pmid: 24919348 url: http://www.ncbi.nlm.nih.gov/pubmed/24919348
[73] Yang J., Kitada R., Kochiyama T., Yu Y., Kai M., Araki Y., .. Sadato N . ( 2017). Brain networks involved in tactile speed classification of moving dot patterns: The effects of speed and dot periodicity. Scientific Reports, 7, 40931).
pmid: 5286508 url: http://www.ncbi.nlm.nih.gov/pubmed/28145505
[74] Yang J., Yu Y., Kunita A., Qiang H., Wu J., Sawamoto N., & Fukuyama H . ( 2014). Tactile priming modulates the activation of the fronto-parietal circuit during tactile angle match and non-match processing: An fMRI study. Frontiers in Human Neuroscience, 8, (926), 926.
pmid: 25566010 url: http://europepmc.org/abstract/med/25566010
[75] Yau J. M., Kim S. S., Thakur P. H., & Bensmaia S. J . ( 2016). Feeling form: the neural basis of haptic shape perception. Journal of Neurophysiology, 115, (2), 631-642.
pmid: 26581869 url: http://europepmc.org/abstract/MED/26581869
[76] Yoshida T., Yamaguchi A., Tsutsui H., & Wake T . ( 2015). Tactile search for change has less memory than visual search for change. Attention Perception & Psychophysics, 77, (4), 1200-1211.
pmid: 25724516 url: http://link.springer.com/article/10.3758/s13414-014-0829-6
[77] Yu J., Wu Q., Yang J., Takahashi S., Ejima Y., & Wu J . ( 2017). A study of shape discrimination for tactile guide maps. IEEE International Conference on Mechatronics and Automation( pp.565-570). IEEE.
url: http://ieeexplore.ieee.org/document/8015879/
[1] ZHOU Aibao; ZHANG Yanchi; LIU Peiru; YIN Yulong; ZHANG Fen. Who am I ? ——Enfacement Illusion Based on Interpersonal Multisensory Stimulation[J]. Advances in Psychological Science, 2015, 23(2): 159-167.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Advances in Psychological Science
Support by Beijing Magtech