Advances in Psychological Science ›› 2024, Vol. 32 ›› Issue (5): 790-799.doi: 10.3724/SP.J.1042.2024.00790
• Regular Articles • Previous Articles Next Articles
WANG Yuling, LU Xiaowei, WU Zongjie, LI Guogen, ZHANG Lin
Received:
2023-09-07
Online:
2024-05-15
Published:
2024-03-05
WANG Yuling, LU Xiaowei, WU Zongjie, LI Guogen, ZHANG Lin. The cross-modal integration process in facial attractiveness judgments[J]. Advances in Psychological Science, 2024, 32(5): 790-799.
[1] 周雯, 冯果. (2012). 嗅知觉及其与情绪系统的交互. [2] Aglieri V., Watson R., Pernet C., Latinus M., Garrido L., & Belin P. (2017). The glasgow voice memory test: Assessing the ability to memorize and recognize unfamiliar voices.Behavior Research Methods, 49(1), 97-110. [3] Allison T., Puce A., & McCarthy G. (2000). Social perception from visual cues: Role of the STS region.Trends in Cognitive Sciences, 4(7), 267-278. [4] Alsius A., Navarra J., Campbell R., & Soto-Faraco S. (2005). Audiovisual integration of speech falters under high attention demands.Current Biology, 15(9), 839-843. [5] Badde S., Navarro K. T., & Landy M. S. (2020). Modality-specific attention attenuates visual-tactile integration and recalibration effects by reducing prior expectations of a common source for vision and touch.Cognition, 197, 104170. [6] Belin P., Zatorre R. J., Lafaille P., Ahad P., & Pike B. (2000). Voice-selective areas in human auditory cortex.Nature, 403, 309-312. [7] Bestelmeyer, P. E. G., & Mühl, C. (2021). Individual differences in voice adaptability are specifically linked to voice perception skill.Cognition, 210, 104582. [8] Bowdring M. A., Sayette M. A., Girard J. M., & Woods W. C. (2021). In the eye of the beholder: A comprehensive analysis of stimulus type, perceiver, and target in physical attractiveness perceptions.Journal of Nonverbal Behavior, 45(2), 241-259. [9] Broadbent H., Osborne T., Mareschal D., & Kirkham N. (2020). Are two cues always better than one? The role of multiple intra-sensory cues compared to multi-cross- sensory cues in children’s incidental category learning. Cognition, 199, 104202. [10] Calvert G. A., Brammer M. J., & Iversen S. D. (1998). Crossmodal identification.Trends in Cognitive Sciences, 2(7), 247-253. [11] Campanella, S., & Belin, P. (2007). Integrating face and voice in person perception.Trends in Cognitive Sciences, 11(12), 535-543. [12] Cao Y., Summerfield C., Park H., Giordano B. L., & Kayser C. (2019). Causal inference in the multisensory brain.Neuron, 102(5), 1076-1087. [13] Chen K., Zhou B., Chen S., He S., & Zhou W. (2013). Olfaction spontaneously highlights visual saliency map.Proceedings of the Royal Society B: Biological Sciences, 280(1768), 20131729. [14] Chen, Y. C., & Spence, C. (2017). Assessing the role of the ‘unity assumption’ on multisensory integration: A review.Frontiers in Psychology, 8, 445. [15] Collins, S. A., & Missing, C. (2003). Vocal and visual attractiveness are related in women.Animal Behaviour, 65(5), 997-1004. [16] Cook S., Kokmotou K., Soto V., Fallon N., Tyson-Carr J., Thomas A., .. Stancak A. (2017). Pleasant and unpleasant odour-face combinations influence face and odour perception: An event-related potential study.Behavioural Brain Research, 333, 304-313. [17] Cook S., Kokmotou K., Soto V., Wright H., Fallon N., Thomas A., .. Stancak A. (2018). Simultaneous odour-face presentation strengthens hedonic evaluations and event-related potential responses influenced by unpleasant odour.Neuroscience Letters, 672, 22-27. [18] Damjanovic L., Wilkinson H., & Lloyd J. (2018). Sweet emotion: The role of odor-induced context in the search advantage for happy facial expressions.Chemical Senses, 43(3), 139-150. [19] Debats N. B., Heuer H., & Kayser C. (2021). Visuo- proprioceptive integration and recalibration with multiple visual stimuli.Scientific Reports, 11(1), 21640. [20] Drimalla H., Landwehr N., Hess U., & Dziobek I. (2019). From face to face: The contribution of facial mimicry to cognitive and emotional empathy. Cognition and Emotion, 33(8), 1672-1686. [21] Fairhall, S. L., & Macaluso, E. (2009). Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites. European Journal of Neuroscience, 29(6), 1247-1257. [22] Feng, G., & Lei, J. (2022). The effect of odor valence on facial attractiveness judgment: A preliminary experiment.Brain Sciences, 12(5), 665. [23] Fraccaro P. J., Feinberg D. R., DeBruine L. M., Little A. C., Watkins C. D., & Jones B. C. (2010). Correlated male preferences for femininity in female faces and voices.Evolutionary Psychology, 8(3), 447-461. [24] French, R. L., & DeAngelis, G. C. (2020). Multisensory neural processing: From cue integration to causal inference.Current Opinion in Physiology, 16, 8-13. [25] Groyecka A., Pisanski K., Sorokowska A., Havlíček J., Karwowski M., Puts D., .. Sorokowski P. (2017). Attractiveness is multimodal: Beauty is also in the nose and ear of the beholder.Frontiers in Psychology, 8, 778. [26] Han S., Liu S., Gan Y., Xu Q., Xu P., Luo Y., & Zhang L. (2020). Repeated exposure makes attractive faces more attractive: Neural responses in facial attractiveness judgement.Neuropsychologia, 139, 107365. [27] Helbig, H. B., & Ernst, M. O. (2007). Knowledge about a common source can promote visual-haptic integration.Perception, 36(10), 1523-1533. [28] Hermann C., Ziegler S., Birbaumer N., & Flor H. (2000). Pavlovian aversive and appetitive odor conditioning in humans: Subjective, peripheral, and electrocortical changes.Experimental Brain Research, 132(2), 203-215. [29] Hughes, S. M., & Miller, N. E. (2016). What sounds beautiful looks beautiful stereotype: The matching of attractiveness of voices and faces. Journal of Social and Personal Relationships, 33(7), 984-996. [30] Jones B. C., Little A. C., Burt D. M., & Perrett D. I. (2004). When facial attractiveness is only skin deep.Perception, 33, 569-576. [31] Jones, E. G., & Powell, T. P. S. (1970). An anatomical study of converging sensory pathways within the cerebral cortex of the monkey.Brain, 93(4), 793-820. [32] Kahnt T., Heinzle J., Park S. Q., & Haynes J. D. (2010). The neural code of reward anticipation in human orbitofrontal cortex. Proceedings of the National Academy of Sciences, 107(13), 6010-6015. [33] Kayser, C., & Shams L. (2015). Multisensory causal inference in the brain.Plos Biology, 13(2), e1002075. [34] Kirsch, W., & Kunde, W. (2023). On the role of interoception in body and object perception: A multisensory-integration account. Perspectives on Psychological Science, 18(2), 321-339. [35] Klümper L., Wühr P., Hassebrauck M., & Schwarz S. (2020). Automaticity of facial attractiveness perception and sex-specific mating strategies. Cognition, 204, 104379. [36] Knowles, K. K., & Little, A. C. (2016). Vocal fundamental and formant frequencies affect perceptions of speaker cooperativeness.Quarterly Journal of Experimental Psychology, 69(9), 1657-1675. [37] Körding K. P., Beierholm U., Ma W. J., Quartz S., Tenenbaum J. B., & Shams L. (2007). Causal inference in multisensory perception.Plos One, 2(9), e943. [38] Kowal M., Sorokowski P., Pisanski K., Valentova J. V., Varella M. A., Frederick D. A., .. Espinosa , M. Z. (2022). Predictors of enhancing human physical attractiveness: Data from 93 countries.Evolution and Human Behavior, 43(6), 455-474. [39] Lavan N., Mileva M., Burton A. M., Young A. W., & McGettigan C. (2021). Trait evaluations of faces and voices: Comparing within-and between-person variability.Journal of Experimental Psychology: General, 150(9), 1854. [40] Li, J., & Deng, S. W. (2023). Facilitation and interference effects of the multisensory context on learning: A systematic review and meta-analysis.Psychological Research, 87(5), 1334-1352. [41] Li W., Moallem I., Paller K. A., & Gottfried J. A. (2007). Subliminal smells can guide social preferences.Psychological Science, 18(12), 1044-1049. [42] Little A. C., Jones B. C., & DeBruine L. M. (2011). Facial attractiveness: Evolutionary based research.Philosophical Transactions of the Royal Society B: Biological Sciences, 366(1571), 1638-1659. [43] Liu M., Sommer W., Yue S., & Li W. (2023). Dominance of face over voice in human attractiveness judgments: ERP evidence.Psychophysiology, 60(11), e14358. [44] Macaluso E., George N., Dolan R., Spence C., & Driver J. (2004). Spatial and temporal factors during processing of audiovisual speech: PET study.Neuroimage, 21(2), 725-732. [45] Maddox R. K., Atilgan H., Bizley J. K., & Lee A. K. (2015). Auditory selective attention is enhanced by a task-irrelevant temporally coherent visual stimulus in human listeners.Elife, 4, e04995. [46] Marchant J. L., Ruff C. C., & Driver J. (2012). Audiovisual synchrony enhances BOLD responses in a brain network including multisensory STS while also enhancing target‐detection performance for both modalities.Human Brain Mapping, 33(5), 1212-1224. [47] Marin M. M., Schober R., Gingras B., & Leder H. (2017). Misattribution of musical arousal increases sexual attraction towards opposite-sex faces in females.Plos One, 12(9), e0183531. [48] McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices.Nature, 264(5588), 746-748. [49] Mei M., Grillot R. L., Abbey C. K., Emery Thompson M., & Roney J. R. (2022). Does scent attractiveness reveal women's ovulatory timing? Evidence from signal detection analyses and endocrine predictors of odour attractiveness.Proceedings of the Royal Society B, 289(1970), 20220026. [50] Miller, J. (1982). Divided attention: Evidence for coactivation with redundant signals.Cognitive Psychology, 14(2), 247-279. [51] Moller, A. P., & Pomiankowski, A. (1993). Why have birds got multiple sexual ornaments?Behavioral Ecology and Sociobiology, 32(3), 167-176. [52] Mühl C., Sheil O., Jarutyte L., & Bestelmeyer, P. E. G. (2018). The bangor voice matching test: A standardized test for the assessment of voice perception ability.Behavior Research Methods, 50(6), 2184-2192. [53] Noesselt T., Bergmann D., Heinze H. J., Münte T., & Spence C. (2012). Coding of multisensory temporal patterns in human superior temporal sulcus.Frontiers in Integrative Neuroscience, 6, 64. [54] O’Connor J. J. M., Fraccaro P. J., Pisanski K., Tigue C. C., & Feinberg D. R. (2013). Men’s preferences for women’s femininity in dynamic cross-modal stimuli.Plos One, 8(7), e69531. [55] Olofsson, J. K., & Gottfried, J. A. (2015). The muted sense: Neurocognitive limitations of olfactory language.Trends in Cognitive Sciences, 19(6), 314-321. [56] Pan Y., Jin J., Wan Y., Wu Y., Wang F., Xu S., .. & Rao H. (2022). Beauty affects fairness: Facial attractiveness alters neural responses to unfairness in the ultimatum game. Brain Imaging and Behavior, 16(6), 2497-2505. [57] Panagiotopoulou E., Crucianelli L., Lemma A., & Fotopoulou A. (2022). Identifying with the beautiful: Facial attractiveness effects on unisensory and multisensory self-other distinction.Quarterly Journal of Experimental Psychology, 75(7), 1314-1329. [58] Pisanski K., Fraccaro P. J., Tigue C. C., O'Connor J. J., & Feinberg D. R. (2014). Return to Oz: Voice pitch facilitates assessments of men’s body size.Journal of Experimental Psychology: Human Perception and Performance, 40(4), 1316-1331. [59] Porada D. K., Regenbogen C., Seubert J., Freiherr J., & Lundström J. N. (2019). Multisensory enhancement of odor object processing in primary olfactory cortex.Neuroscience, 418, 254-265. [60] Rhodes, G. (2006). The evolutionary psychology of facial beauty.Annual Review of Psychology, 57, 199-226. [61] Rinaldi L., Maggioni E., Olivero N., Maravita A., & Girelli L. (2018). Smelling the space around us: Odor pleasantness shifts visuospatial attention in humans.Emotion, 18(7), 971-979. [62] Roberts S. C., Kralevich A., Ferdenzi C., Saxton T. K., Jones B. C., DeBruine L. M., … Havlicek J. (2011). Body odor quality predicts behavioral attractiveness in humans.Archives of Sexual Behavior, 40(6), 1111-1117. [63] Rokni D., Hemmelder V., Kapoor V., & Murthy V. N. (2014). An olfactory cocktail party: Figure-ground segregation of odorants in rodents.Nature Neuroscience, 17(9), 1225-1232. [64] Romanski, L. M. (2012). Convergence of auditory, visual, and somatosensory information in ventral prefrontal cortex. In M.M. Murray, M.T. Wallace (Eds.), [65] Rubenstein, A. J. (2005). Variation in perceived attractiveness: Differences between dynamic and static faces.Psychological Science, 16(10), 759-762. [66] Scheller, M., & Sui, J. (2022). Social relevance modulates multisensory integration.Journal of Experimental Psychology: Human Perception and Performance, 48(9), 1022-1038. [67] Seubert J., Gregory K. M., Chamberland J., Dessirier J. M., & Lundström J. N. (2014). Odor valence linearly modulates attractiveness, but not age assessment, of invariant facial features in a memory-based rating task.Plos One, 9(5), e98347. [68] Shams, L., & Beierholm, U. (2022). Bayesian causal inference: A unifying neuroscience theory. Neuroscience & Biobehavioral Reviews, 137, 104619. [69] Sorokowska, A. (2013). Assessing personality using body odor: Differences between children and adults.Journal of Nonverbal Behavior, 37, 153-163. [70] Sorokowski P., Kościński K., & Sorokowska A. (2013). Is beauty in the eye of the beholder but ugliness culturally universal? Facial preferences of Polish and Yali (Papua) people.Evolutionary Psychology, 11, 907-925. [71] Spence, C. (2021). The scent of attraction and the smell of success: Crossmodal influences on person perception.Cognitive Research: Principles and Implications, 6(1), 1-33. [72] Steinberg C., Dobel C., Schupp H. T., Kissler J., Elling L., Pantev C., & Junghofer M. (2012). Rapid and highly resolving: Affective evaluation of olfactorily conditioned faces.Journal of Cognitive Neuroscience, 24(1), 17-27. [73] Syrjänen E., Fischer H., Liuzza M. T., Lindholm T., & Olofsson J. K. (2021). A review of the effects of valenced odors on face perception and evaluation.I-Perception, 12(2), 1-19. [74] Syrjänen E., Liuzza M. T., Fischer H., & Olofsson J. K. (2017). Do valenced odors and trait body odor disgust affect evaluation of emotion in dynamic faces?.Perception, 46(12), 1412-1426. [75] Syrjänen E., Wiens S., Fischer H., Zakrzewska M., Wartel A., Larsson M., & Olofsson J. K. (2018). Background odors modulate N170 ERP component and perception of emotional facial stimuli.Frontiers in Psychology, 9, 1000. [76] Tybur J. M., Cinar C., Karinen A. K., & Perone P. (2018). Why do people vary in disgust? Philosophical transactions of the royal society of London.Series B: Biological Sciences, 373(1751), 1-10. [77] Valentine, T. (1991). A unified account of the effects of distinctiveness, inversion, and race in face recognition.The Quarterly Journal of Experimental Psychology, 43(2), 161-204. [78] Van Atteveldt N. M., Formisano E., Blomert L., & Goebel R. (2007). The effect of temporal asynchrony on the multisensory integration of letters and speech sounds.Cerebral Cortex, 17(4), 962-974. [79] Van der Burg E., Rhodes G., & Alais D. (2019). Positive sequential dependency for face attractiveness perception.Journal of Vision, 19(12), 6-6. [80] Wen F., Gao J., Ke W., Zuo B., Dai Y., Ju Y., & Long J. (2023). The Effect of face-voice gender consistency on impression evaluation.Archives of Sexual Behavior, 52(3), 1123-1139. [81] White, D., & Burton, A. M. (2022). Individual differences and the multidimensional nature of face perception.Nature Reviews Psychology, 1(5), 287-300. [82] Wuttke, S. J., & Schweinberger, S. R. (2019). The P200 predominantly reflects distance-to-norm in face space whereas the N250 reflects activation of identity-specific representations of known faces.Biological Psychology, 140, 86-95. [83] Yu, R. (2023). Unconscious integration: Current evidence for integrative processing under subliminal conditions.British Journal of Psychology, 114(2), 430-456. [84] Zäske R., Skuk V. G., & Schweinberger S. R. (2020). Attractiveness and distinctiveness between speakers’ voices in naturalistic speech and their faces are uncorrelated.Royal Society Open Science, 7(12), 201244. |
[1] | ZHENG Yuanxia, LIU Guoxiong, XIN Cong, CHENG Li. Judging a book by its cover: The influence of facial features on children’s trust judgments [J]. Advances in Psychological Science, 2024, 32(2): 300-317. |
[2] | Chang Chen, W. Paul Boyce, Colin J. Palmer, Colin W.G. Clifford. poral Contextual Modulation on Perceived Walking Direction [J]. Advances in Psychological Science, 2023, 31(suppl.): 35-35. |
[3] | Ruoying Zheng, Guomei Zhou. The Cheerleader Effect in Multiple Social Groups [J]. Advances in Psychological Science, 2023, 31(suppl.): 47-47. |
[4] | Yan-Ru Chen, Yu-Wei Zhang, Jun-Yun Zhang. The Impact of Training on the Inner-outer Asymmetry in Crowding [J]. Advances in Psychological Science, 2023, 31(suppl.): 112-112. |
[5] | Da Wang, Zhihao Yang, Gaoxing Mei. Serial Dependence in the Ensemble Perception of Facial Attractiveness and Facial Expression [J]. Advances in Psychological Science, 2023, 31(suppl.): 114-114. |
[6] | Yuwei Cui, MiYoung Kwon, Nihong Chen. Learning Improves Peripheral Vision via Enhanced Cortico-cortical Communications [J]. Advances in Psychological Science, 2023, 31(suppl.): 161-161. |
[7] | Xunbing Shen, Xiaoqing Mei, Min Gao, Zhencai Chen, Yafang Li, Mingliang Gong. Eyes are the Windows of Lies [J]. Advances in Psychological Science, 2023, 31(suppl.): 172-172. |
[8] | Xin Zhou, Xunbing Shen, Yuxi Zhou, Zhenzhen Tao. Fear Expression Outperforms Happiness as a Lie Detection Indicator [J]. Advances in Psychological Science, 2023, 31(suppl.): 177-177. |
[9] | Yuxi Zhou, Xunbing Shen. Emotion Elicitation Promote the Disclosure of Facial Deception Cues [J]. Advances in Psychological Science, 2023, 31(suppl.): 179-179. |
[10] | Yao Chen, Shiqi Zhou, Yiya Chen, Hao Chen, Robert F. Hess, Jiawei Zhou. Abnormal Lateral Motion after Visual Acuity Recovery in Anisometropic Amblyopia [J]. Advances in Psychological Science, 2023, 31(suppl.): 9-9. |
[11] | PU Xiaoping, HU Hao, ZHU Jina, TANG Yipeng. Influence of facial attractiveness on the allocation of attentional resources: Moderating effect of evolutionary motivations [J]. Advances in Psychological Science, 2023, 31(7): 1109-1120. |
[12] | CHEN Shiting, YANG Wendeng. The effect of olfaction on social judgment and decision-making and its mechanism [J]. Advances in Psychological Science, 2023, 31(10): 1899-1911. |
[13] | LIANG Fei, JIANG Yao, XIAO Tingwei, DONG Jie, WANG Fushun. Basic emotion and its neural basis: Evidence from fMRI and machine-vision studies [J]. Advances in Psychological Science, 2022, 30(8): 1832-1843. |
[14] | ZHOU Guomei, ZHENG Ruoying, LIN Jia, LIU Xinge. The holistic representation of facial attractiveness and the attractiveness enhancement mechanism of dynamic faces [J]. Advances in Psychological Science, 2022, 30(7): 1429-1438. |
[15] | WANG Haizhen, GENG Zizhen, DING Lin, SHAN Chunxia. Antecedents of abusive supervision [J]. Advances in Psychological Science, 2022, 30(4): 906-921. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||