The affects of facial expression and gaze direction on face processing: Based on perceptual load theory

doi:10.3724/SP.J.1042.2018.00984

Abstract

Abstract:

As perceptual load theory of attention posits, the effectiveness of selective attention in excluding perception of irrelevant distractors depends on the perceptual load associated with the relevant task. If the perceptual load of the relevant task is sufficiently high so as to require all available attentional capacity, thus the processing of task-irrelevant distractors is prevented. However, facial processing is special, irrelevant face can be processed regardless of the level of perceptual load. And facial expression and gaze direction may be affected by perceptual load. Some studies showed that negative emotions was less affected by the perceptual load, compared with positive and neutral emotions; Perception of direct gaze does not require focus of attention. In the future, we can extend to investigate the effects of some categories such as race, sex, and age in different levels of perceptual load.

Key words: face perfection, perceptual load, attention resources, facial expression, gaze orientation

CLC Number:

B842

ZHANG Kaili, ZHOU Pei, WANG Pei. The affects of facial expression and gaze direction on face processing: Based on perceptual load theory[J]. Advances in Psychological Science, 2018, 26(6): 984-993.

References 79

[1]	田夏, 刘培朵, 陈安涛 . ( 2012). 熟悉面孔在不同知觉负荷条件下的表征方式. 西南大学学报(自然科学版), 34( 4), 139-145.
[2]	魏萍, 周晓林 . ( 2005). 从知觉负载理论来理解选择性注意. 心理科学进展, 13( 4), 413-420. doi: 10.3969/j.issn.1671-3710.2005.04.005 URL
[3]	吴彬星, 张智君, 孙雨生 . ( 2015). 面孔熟悉度对面孔性别与表情相互作用的调节. 心理学报, 47( 10), 1201-1212. doi: 10.3724/SP.J.1041.2015.01201 URL
[4]	Barratt, D., & Bundesen, C. (2012). Attentional capture by emotional faces is contingent on attentional control settings. Cognition & Emotion, 26( 7), 1223-1237. doi: 10.1080/02699931.2011.645279 URL pmid: 22416914
[5]	Blagrove, E., & Watson, D. G . ( 2010). Visual marking and facial affect: Can an emotional face be ignored? Emotion, 10( 2), 147-168. doi: 10.1037/a0017743 URL pmid: 20364892
[6]	Burton A. M., Bindemann M., Langton S. R. H., Schweinberger S. R., & Jenkins R . ( 2009). Gaze perception requires focused attention: Evidence from an interference task. Journal of Experimental Psychology: Human Perception and Performance, 35( 1), 108-118. doi: 10.1037/0096-1523.35.1.108 URL pmid: 19170474
[7]	Calder A. J., Lawrence A. D., Keane J., Scott S. K., Owen A. M., Christoffels I., & Young A. W . ( 2002). Reading the mind from eye gaze. Neuropsychologia, 40( 8), 1129-1138. doi: 10.1016/S0028-3932(02)00008-8 URL
[8]	Caudek, C. (2013). The fidelity of visual memory for faces and non-face objects. Acta Psychologica, 143( 1), 40-51. doi: 10.1016/j.actpsy.2012.12.002 URL pmid: 23500113
[9]	Compton, R. J . ( 2003). The interface between emotion and attention: A review of evidence from psychology and neuroscience. Behavioral and Cognitive Neuroscience Reviews, 2( 2), 115-129. doi: 10.1177/1534582303255278 URL pmid: 13678519
[10]	Conty L., N'Diaye K., Tijus C., & George N . ( 2007). When eye creates the contact! ERP evidence for early dissociation between direct and averted gaze motion processing. Neruopsychologia, 45( 13), 3024-3037. doi: 10.1046/j.1523-1747.2003.12244.x URL pmid: 17644145
[11]	Damjanovic L., Pinkham A. E., Clarke P., & Phillips J . ( 2014). Enhanced threat detection in experienced riot police officers: Cognitive evidence from the face-in-the- crowd effect. The Quarterly Journal of Experimental Psychology, 67( 5), 1004-1018. doi: 10.1080/17470218.2013.839724 URL pmid: 24152089
[12]	de Fockert, J. W., & Gautrey, B. (2013). Greater visual averaging of face identity for own-gender faces. Psychonomic Bulletin & Review, 20( 3), 468-473. doi: 10.3758/s13423-013-0381-8 URL pmid: 23355045
[13]	Downing P. E., Bray D., Rogers J., & Childs C . ( 2004). Bodies capture attention when nothing is expected. Cognition, 93( 1), B27-B38. doi: 10.1016/j.cognition.2003.10.010 URL pmid: 15110728
[14]	Eitam B., Glass-Hackel R., Aviezer H., Dienes Z., Shoval R., & Higgins E. T . ( 2014). Are task irrelevant faces unintentionally processed? Implicit learning as a test case. Journal of Experimental Psychology: Human Perception and Performance, 40( 5), 1741-1747. doi: 10.1037/a0037627 URL pmid: 25151101
[15]	Eltiti S., Wallace D., & Fox E . ( 2005). Selective target processing: Perceptual load or distractor salience? Perception & Psychophysics, 67( 5), 876-885. doi: 10.3758/BF03193540 URL pmid: 16334059
[16]	Farroni T., Csibra G., Simion F., & Johnson M. H . ( 2002). Eye contact detection in humans from birth. Proceedings of the National Academy of Sciences of the United States of America, 99( 14), 9602-9605. doi: 10.1073/pnas.152159999 URL pmid: 12082186
[17]	Fox E., Yates A., & Ashwin C . ( 2012). Trait anxiety and perceptual load as determinants of emotion processing in a fear conditioning paradigm. Emotion, 12( 2), 236-249. doi: 10.1037/a0025321 URL pmid: 21875186
[18]	Freeman J. B., Ambady N., & Holcomb P. J . ( 2010). The face-sensitive N170 encodes social category information. Neuroreport, 21( 1), 24-28. doi: 10.1097/WNR.0b013e3283320d54 URL pmid: 19864961
[19]	Frischen A., Bayliss A. P., & Tipper S. P . ( 2007). Gaze cueing of attention: visual attention, social cognition, and individual differences. Psychological Bulletin, 133( 4), 694-724. doi: 10.1037/0033-2909.133.4.694 URL pmid: 17592962
[20]	Grammer K., Fink B., Møller A. P., & Thornhill R . ( 2003). Darwinian aesthetics: sexual selection and the biology of beauty. Biological Reviews, 78( 3), 385-407. doi: 10.1017/S1464793102006085 URL pmid: 14558590
[21]	Güntekin, B., & Başar, E. (2014). A review of brain oscillations in perception of faces and emotional pictures. Neuropsychologia, 58, 33-51. doi: 10.1016/j.neuropsychologia.2014.03.014 URL pmid: 24709570
[22]	Gupta, R., & Srinivasan, N. (2015). Only irrelevant sad but not happy faces are inhibited under high perceptual load. Cognition and Emotion, 29( 4), 747-754. doi: 10.1080/02699931.2014.933735 URL pmid: 24998248
[23]	Hains, P., & Baillargeon, J. (2010). Le rôle de la charge perceptuelle dans le traitement de distracteurs visuels : le visage humain est-il vraiment particulier. L'Année Psychologique, 110( 2), 181-195. doi: 10.4074/S0003503310002010 URL
[24]	Hains, P., & Baillargeon, J. (2011). La face animale et le visage humain sont-ils équivalents ? Une étude dans le cadre de la théorie de la charge perceptuelle. L’Année psychologique, 111( 3), 449-463. doi: 10.4074/S0003503311003010 URL
[25]	Hauthal N., Neumann M. F., & Schweinberger S. R . ( 2012). Attentional spread in deaf and hearing participants: Face and object distractor processing under perceptual load. Attention, Perception, & Psychophysics, 74( 6), 1312-1320. doi: 10.3758/s13414-012-0320-1 URL pmid: 22638944
[26]	He, C., & Chen, A. (2010). Interference from familiar natural distractors is not eliminated by high perceptual load. Psychological Research PRPF, 74( 3), 268-276. doi: 10.1007/s00426-009-0252-0 URL pmid: 19652997
[27]	Herzmann G., Schweinberger S. R., Sommer W., & Jentzsch I . ( 2004). What's special about personally familiar faces? A multimodal approach. Psychophysiology, 41( 5), 688-701. doi: 10.1111/j.1469-8986.2004.00196.x URL pmid: 15318875
[28]	Hess U., Adams R. B., Jr., Grammer K., & Kleck R. E . ( 2009). Face gender and emotion expression: Are angry women more like men? Journal of Vision, 9( 12):19. doi: 10.1167/9.12.19 URL pmid: 20053110
[29]	Holmes A., Mogg K., de Fockert J., Nielsen M. K., & Bradley B. P . ( 2014). Electrophysiological evidence for greater attention to threat when cognitive control resources are depleted. Cognitive, Affective, & Behavioral Neuroscience, 14( 2), 827-835. doi: 10.3758/s13415-013-0212-4 URL pmid: 24165903
[30]	Jung K., Ruthruff E., & Gaspelin N . ( 2013). Automatic identification of familiar faces. Attention, Perception, & Psychophysics, 75( 7), 1438-1450. doi: 10.3758/s13414-013-0468-3 URL pmid: 23749679
[31]	Kaltwasser L., Hildebrandt A., Recio G., Wilhelm O., & Sommer W . ( 2014). Neurocognitive mechanisms of individual differences in face cognition: A replication and extension. Cognitive, Affective, & Behavioral Neuroscience, 14( 2), 861-878. doi: 10.3758/s13415-013-0234-y URL pmid: 24379165
[32]	Kleinke, C. L . ( 1986). Gaze and eye contact: A research review. Psychological Bulletin, 100( 1), 78-100. doi: 10.1037/0033-2909.100.1.78 URL pmid: 3526377
[33]	Kloth N., Damm M., Schweinberger S. R., & Wiese H . ( 2015). Aging affects sex categorization of male and female faces in opposite ways. Acta Psychological, 158, 78-86. doi: 10.1016/j.actpsy.2015.04.005 URL pmid: 25974392
[34]	Komes J., Schweinberger S. R., & Wiese H . ( 2014). Preserved fine-tuning of face perception and memory: Evidence from the own-race bias in high- and low-performing older adults. Frontiers in Aging Neuroscience, 6, 60. doi: 10.3389/fnagi.2014.00060 URL pmid: 3983485
[35]	Lavie, N. (1995). Perceptual load as a necessary condition for selective attention. Journal of Experimental Psychology: Human Perception and Performance, 21( 3), 451-468. doi: 10.1037//0096-1523.21.3.451 URL pmid: 7790827
[36]	Lavie, N. (2010). Attention, distraction, and cognitive control under load. Current Directions in Psychological Science, 19( 3), 143-148. doi: 10.1177/0963721410370295 URL
[37]	Lavie, N., & de Fockert, J. W . ( 2003). Contrasting effects of sensory limits and capacity limits in visual selective attention. Perception & Psychophysics, 65( 2), 202-212. doi: 10.3758/BF03194795 URL pmid: 12713239
[38]	Lavie N., Hirst A., de Fockert J. W., & Viding E . ( 2004). Load theory of selective attention and cognitive control. Journal of Experimental Psychology: General, 133( 3), 339-354. doi: 10.1037/0096-3445.133.3.339 URL pmid: 15355143
[39]	Lavie N., Lin Z., Zokaei N., & Thoma V . ( 2009). The role of perceptual load in object recognition. Journal of Experimental Psychology: Human Perception and Performance, 35( 5), 1346-1358. doi: 10.1037/a0016454 URL pmid: 19803641
[40]	Lavie N., Ro T., & Russell C . ( 2003). The role of perceptual load in processing distractor faces. Psychological Science, 14( 5), 510-515. doi: 10.1111/1467-9280.03453 URL pmid: 12930485
[41]	Lipp, O. V., Derakshan, N. (2005). Attentional bias to pictures of fear-relevant animals in a dot probe task. Emotion, 5( 3), 365-369. doi: 10.1037/1528-3542.5.3.365 URL pmid: 16187873
[42]	Maquestiaux F., Laguë-Beauvais M., Bherer L., & Ruthruff E . ( 2008). Bypassing the central bottleneck after single-task practice in the psychological refractory period paradigm: Evidence for task automatization and greedy resource recruitment. Memory & Cognition, 36(7), 1262-1282. doi: 10.3758/MC.36.7.1262 URL pmid: 18927042
[43]	Minamoto T., Shipstead Z., Osaka N., & Engle R. W . ( 2015). Low cognitive load strengthens distractor interference while high load attenuates when cognitive load and distractor possess similar visual characteristics. Attention, Perception, & Psychophysics, 77( 5), 1659-1673. doi: 10.3758/s13414-015-0866-9 URL pmid: 25813738
[44]	Murray J. E., Judge M., & Chen Y . ( 2012). Ignored faces produce figural face aftereffects. PLoS One, 7( 9), e45928. doi: 10.1371/journal.pone.0045928 URL pmid: 3448676
[45]	Murray J. E., Machado L., & Knight B . ( 2011). Race and gender of faces can be ignored. Psychological Research, 75( 4), 324-333. doi: 10.1007/s00426-010-0310-7 URL pmid: 20949279
[46]	Neath, K. N., & Itier, R. J . ( 2015). Fixation to features and neural processing of facial expressions in a gender discrimination task. Brain and Cognition, 99, 97-111. doi: 10.1016/j.bandc.2015.05.007 URL pmid: 26277653
[47]	Neumann M. F., Mohamed T. N., & Schweinberger S. R . ( 2011). Face and object encoding under perceptual load: ERP evidence. NeuroImage, 54( 4), 3021-3027. doi: 10.1016/j.neuroimage.2010.10.075 URL pmid: 21044688
[48]	Neumann, M. F., & Schweinberger, S. R . ( 2009). N250r ERP repetition effects from distractor faces when attending to another face under load: Evidence for a face attention resource. Brain Research, 1270, 64-77. doi: 10.1016/j.str.2006.05.021 URL pmid: 19306855
[49]	Öhman A., Lundqvist D., & Esteves F . ( 2001). The face in the crowd revisited: A threat advantage with schematic stimuli. Journal of Personality and Social Psychology, 80( 3), 381-396. doi: 10.1037/0022-3514.80.3.381 URL
[50]	Okon-Singer H., Lichtenstein-Vidne L., & Cohen N . ( 2013). Dynamic modulation of emotional processing. Biological Psychology, 92( 3), 480-491. doi: 10.1016/j.biopsycho.2012.05.010 URL pmid: 22676964
[51]	Olk, B., & Garay-Vado, A. M . ( 2011). Attention to faces: Effects of face inversion. Vision Research, 51( 14), 1659-1666. doi: 10.1016/j.visres.2011.05.007 URL pmid: 21624383
[52]	Pageler N. M., Menon V., Merin N. M., Eliez S., Brown W. E., & Reiss A. L . ( 2003). Effect of head orientation on gaze processing in fusiform gyrus and superior temporal sulcus. NeuroImage, 20( 1), 318-329. doi: 10.1016/S1053-8119(03)00229-5 URL pmid: 14527592
[53]	Palanica, A., & Itier, R. J . ( 2012). Attention capture by direct gaze is robust to context and task demands. Journal of Nonverbal Behavior, 36( 2), 123-134. doi: 10.1007/s10919-011-0128-z URL pmid: 4072644
[54]	Palermo, R., & Rhodes, G. (2007). Are you always on my mind? A review of how face perception and attention interact. Neuropsychologia, 45( 1), 75-92. doi: 10.1016/j.neuropsychologia.2006.04.025 URL pmid: 16797607
[55]	Persike M., Meinhardt-Injac B., & Meinhardt G . ( 2013). The preview benefit for familiar and unfamiliar faces. Vision Research, 87, 1-9. doi: 10.1016/j.visres.2013.05.005 URL pmid: 23694681
[56]	Quinn, K. A., & Macrae, C. N . ( 2011). The face and person perception: Insights from social cognition. British Journal of Psychology, 102( 4), 849-867. doi: 10.1111/j.2044-8295.2011.02030.x URL pmid: 21988388
[57]	Raveh, D., & Lavie, N. (2015). Load-induced inattentional deafness. Attention, Perception, & Psychophysics, 77( 2), 483-492.
[58]	Reddy L., Reddy L., & Koch C . ( 2006). Face identification in the near-absence of focal attention. Vision Research, 46( 15), 2336-2343. doi: 10.1016/j.visres.2006.01.020 URL pmid: 16542699
[59]	Reddy L., Wilken P., & Koch C . ( 2004). Face-gender discrimination is possible in the near-absence of attention. Journal of Vision, 4( 2), 106-117. doi: 10.1167/4.8.106 URL
[60]	Rellecke J., Bakirtas A. M., Sommer W., & Schacht A . ( 2011). Automaticity in attractive face processing: Brain potentials from a dual task. Neuroreport, 22( 14), 706-710. doi: 10.1097/WNR.0b013e32834a89ad URL
[61]	Rezlescu C., Penton T., Walsh V., Tsujimura H., Scott S. K., & Banissy M. J . ( 2015). Dominant voices and attractive faces: The contribution of visual and auditory information to integrated person impressions. Journal of Nonverbal Behavior, 39( 4), 355-370. doi: 10.1007/s10919-015-0214-8 URL
[62]	Santangelo, V., & Spence, C. (2008). Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies. Consciousness and Cognition, 17( 3), 989-1015. doi: 10.1016/j.concog.2008.02.006 URL pmid: 18472279
[63]	Sato, S., & Kawahara, J. I . ( 2015). Attentional capture by completely task-irrelevant faces. Psychological Research, 79( 4), 523-533. doi: 10.1007/s00426-014-0599-8 URL pmid: 25030814
[64]	Sato W., Yoshikawa S., Kochiyama T., & Matsumura M . ( 2004). The amygdala processes the emotional significance of facial expressions: An fMRI investigation using the interaction between expression and face direction. NeuroImage, 22( 2), 1006-1013. doi: 10.1016/j.neuroimage.2004.02.030 URL pmid: 15193632
[65]	Senju, A., & Johnson, M. H . ( 2009). The eye contact effect: Mechanisms and development. Trends in Cognitive Sciences, 13( 3), 127-134. doi: 10.1016/j.tics.2008.11.009 URL pmid: 19217822
[66]	Shipstead Z., Harrison T. L., & Engle R. W . ( 2012). Working memory capacity and visual attention: Top-down and bottom-up guidance. The Quarterly Journal of Experimental Psychology, 65( 3), 401-407. doi: 10.1080/17470218.2012.655698 URL pmid: 22404647
[67]	Soares S. C., Rocha M., Neiva T., Rodrigues P., & Silva C. F . ( 2015). Social anxiety under load: The effects of perceptual load in processing emotional faces. Frontiers in Psychology, 6, 479. doi: 10.3389/fpsyg.2015.00479 URL pmid: 4404732
[68]	Sreenivasan K. K., Goldstein J. M., Lustig A. G., Rivas L. R., & Jha A. P . ( 2009). Attention to faces modulates early face processing during low but not high face discriminability. Attention, Perception, & Psychophysics, 71( 4), 837-846. doi: 10.3758/APP.71.4.837 URL pmid: 2854015
[69]	Steffener J., Brickman A. M., Rakitin B. C., Gazes Y., & Stern Y . ( 2009). The impact of age-related changes on working memory functional activity. Brain Imaging and Behavior, 3( 2), 142-153. doi: 10.1007/s11682-008-9056-x URL pmid: 19536354
[70]	Valuch C., Pflüger L. S., Wallner B., Laeng B., & Ansorge U . ( 2015). Using eye tracking to test for individual differences in attention to attractive faces. Frontiers in Psychology, 6, 42. doi: 10.3389/fpsyg.2015.00042 URL pmid: 25698993
[71]	van Rullen, R. (2006). On second glance: Still no high-level pop-out effect for faces. Vision Research, 46( 18), 3017-3027. doi: 10.1016/j.visres.2005.07.009 URL pmid: 16125749
[72]	Wang H., Sun P., Ip C., Zhao X., & Fu S . ( 2015). Configural and featural face processing are differently modulated by attentional resources at early stages: An event-related potential study with rapid serial visual presentation. Brain Research, 1602, 75-84. doi: 10.1016/j.brainres.2015.01.017 URL pmid: 25601005
[73]	Wiese H., Kloth N., Güllmar D., Reichenbach J. R., & Schweinberger S. R . ( 2012). Perceiving age and gender in unfamiliar faces: An fMRI study on face categorization. Brain and Cognition, 78( 2), 163-168. doi: 10.1016/j.bandc.2011.10.012 URL pmid: 22104172
[74]	Wirth B. E., Fisher K., Towler J., & Eimer M . ( 2015). Facial misidentifications arise from the erroneous activation of visual face memory. Neuropsychologia, 77, 387-399. doi: 10.1016/j.neuropsychologia.2015.09.021 URL
[75]	Xu S., Zhang S., & Geng H . ( 2011). Gaze-induced joint attention persists under high perceptual load and does not depend on awareness. Vision Research, 51( 18), 2048-2056. doi: 10.1016/j.visres.2011.07.023 URL pmid: 21840332
[76]	Yang P., Wang M., Jin Z., & Li L . ( 2015). Visual short-term memory load modulates the early attention and perception of task-irrelevant emotional faces. Frontiers in Human Neuroscience, 9, 490. doi: 10.3389/fnhum.2015.00490 URL pmid: 4558536
[77]	Yates A., Ashwin C., & Fox E . ( 2010). Does emotion processing require attention? The effects of fear conditioning and perceptual load. Emotion, 10( 6), 822-830. doi: 10.1037/a0020325 URL pmid: 21058839
[78]	Yokoyama T., Ishibashi K., Hongoh Y., & Kita S . ( 2011). Attentional capture by change in direct gaze. Perception, 40( 7), 785-797. doi: 10.1068/p7003 URL pmid: 22128551
[79]	Yokoyama T., Sakai H., Noguchi Y., & Kita S . ( 2014). Perception of direct gaze does not require focus of attention. Scientific Report, 4, 3858. doi: 10.1038/srep03858 URL pmid: 24618808