Acta Psychologica Sinica ›› 2026, Vol. 58 ›› Issue (11): 2251-2269.doi: 10.3724/SP.J.1041.2026.2251
Previous Articles Next Articles
Received:2026-02-20
Published:2026-11-25
Online:2026-09-11
Contact:
Che Zixuan, E-mail: Supported by:WU Jie, CHE Zixuan. (2026). The modulation mechanism of multisensory category learning on feature processing and category selection*. Acta Psychologica Sinica, 58(11), 2251-2269.
Figure 7. Probability density distributions of DDM parameters for prototypical and deviant stimuli. (A) Decision threshold; (B) Drift rate; (C) Non-decision time; (D) Starting-point bias.
Figure 8. Probability density distributions of DDM parameters for target and nontarget categories. (A) Decision threshold; (B) Drift rate; (C) Non-decision time; (D) Starting-point bias.
Figure 9. ERP waveforms and topographic maps for prototypical and deviant stimuli. (A) Mean amplitudes for prototypical and deviant stimuli at TP7, TP8, POZ, and OZ; (B) Mean amplitudes for prototypical and deviant stimuli at FCZ, CZ, CPZ, and PZ; (C) Mean amplitudes for prototypical and deviant stimuli at FZ, FCZ, CZ, CPZ, and PZ; (D) Topographic maps of the difference between prototypical and deviant stimuli for N250, FSP, and LPC.
Figure 10. ERP waveforms and topographic maps for target and nontarget conditions. (A) Mean amplitudes for target and nontarget at FCZ, CZ, and CPZ. (B) Mean amplitudes for target and nontarget at CZ, CPZ, and PZ. (C) Mean amplitudes for target and nontarget at CPZ, PZ, POZ, and OZ. (D) Topographic maps of the difference between target and nontarget for FSP, LPC1, and LPC2.
Figure 11. Changes in frequency-band power for feature processing and category selection. (A) Frequency-band power for prototypical stimuli, deviant stimuli, and the power difference between prototypical and deviant stimuli; (B) Frequency-band power for target stimuli, nontarget stimuli, and the power difference between target and nontarget stimuli.
Figure 12. Influence of ERP components on DDM parameters. (A) Influence of ERP components on drift rate for prototypical and deviant stimuli; (B) Influence of ERP components on starting-point bias for prototypical and deviant stimuli; (C) Influence of ERP components on decision threshold for prototypical and deviant stimuli; (D) Influence of ERP components on drift rate for target and nontarget stimuli; (E) Influence of ERP components on starting-point bias for target and nontarget stimuli; (F) Influence of ERP components on decision threshold for target and nontarget stimuli.
Figure 13. Influence of frequency-band power on DDM parameters. (A) Influence of frequency-band power on drift rate for prototypical and deviant stimuli; (B) Influence of frequency-band power on starting-point bias for prototypical and deviant stimuli; (C) Influence of frequency-band power on decision threshold for prototypical and deviant stimuli; (D) Influence of frequency-band power on drift rate for target and nontarget stimuli; (E) Influence of frequency-band power on starting-point bias for target and nontarget stimuli; (F) Influence of frequency-band power on decision threshold for target and nontarget stimuli.
| [1] |
Cavanagh J. F., Wiecki T. V., Cohen M. X., Figueroa C. M., Samanta J., Sherman S. J., & Frank M. J. (2011). Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold. Nature Neuroscience, 14(11), 1462-1467. https://doi.org/10.1038/nn.2925
doi: 10.1038/nn.2925 URL pmid: 21946325 |
| [2] |
Delorme A., & Makeig S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1), 9-21. https://doi.org/10.1016/j.jneumeth.2003.10.009
doi: 10.1016/j.jneumeth.2003.10.009 URL pmid: 15102499 |
| [3] |
Engel A. K., & Fries P. (2010). Beta-band oscillations—Signalling the status quo? Current Opinion in Neurobiology, 20(2), 156-165. https://doi.org/10.1016/j.conb.2010.02.015
doi: 10.1016/j.conb.2010.02.015 URL |
| [4] |
Faul F., Erdfelder E., Lang A.-G., & Buchner A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175-191. https://doi.org/10.3758/bf03193146.
doi: 10.3758/bf03193146 URL pmid: 17695343 |
| [5] |
Folstein J. R., Monfared S. S., & Maravel T. (2017). The effect of category learning on visual attention and visual representation. Psychophysiology, 54(12), 1855-1871. https://doi.org/10.1111/psyp.12966
doi: 10.1111/psyp.12966 URL pmid: 28776708 |
| [6] |
Folstein J. R., Palmeri T. J., & Gauthier I. (2013). Category learning increases discriminability of relevant object dimensions in visual cortex. Cerebral Cortex, 23(4), 814-823. https://doi.org/10.1093/cercor/bhs067
doi: 10.1093/cercor/bhs067 URL |
| [7] |
Freedman D. J., & Assad J. A. (2006). Experience-dependent representation of visual categories in parietal cortex. Nature, 443(7107), 85-88. https://doi.org/10.1038/nature05078
doi: 10.1038/nature05078 URL |
| [8] |
Freedman D. J., Riesenhuber M., Poggio T., & Miller E. K. (2001). Categorical representations of visual stimuli in the primate prefrontal cortex. Science, 291(5502), 312-316. https://doi.org/10.1126/science.291.5502.312
doi: 10.1126/science.291.5502.312 URL pmid: 11209083 |
| [9] |
Freedman D. J., Riesenhuber M., Poggio T., & Miller E. K. (2003). A comparison of primate prefrontal and inferior temporal cortices during visual categorization. The Journal of Neuroscience, 23(12), 5235-5246. https://doi.org/10.1523/jneurosci.23-12-05235.2003
doi: 10.1523/JNEUROSCI.23-12-05235.2003 URL |
| [10] |
Goldstone R. L. (1994). Influences of categorization on perceptual discrimination. Journal of Experimental Psychology: General, 123(2), 178-200. https://doi.org/10.1037/0096-3445.123.2.178
doi: 10.1037/0096-3445.123.2.178 URL |
| [11] |
Herz D. M., Zavala B. A., Bogacz R., & Brown P. (2016). Neural correlates of decision thresholds in the human subthalamic nucleus. Current Biology, 26(7), 916-920. https://doi.org/10.1016/j.cub.2016.01.051
doi: 10.1016/j.cub.2016.01.051 URL pmid: 26996501 |
| [12] |
Jiang X., Bradley E., Rini R. A., Zeffiro T., Vanmeter J., & Riesenhuber M. (2007). Categorization training results in shape- and category-selective human neural plasticity. Neuron, 53(6), 891-903. https://doi.org/10.1016/j.neuron.2007.02.015
doi: 10.1016/j.neuron.2007.02.015 URL pmid: 17359923 |
| [13] |
Jiang X., Chevillet M. A., Rauschecker J. P., & Riesenhuber M. (2018). Training humans to categorize monkey calls: Auditory feature- and category-selective neural tuning changes. Neuron, 98(2), 405-416.e4. https://doi.org/10.1016/j.neuron.2018.03.014
doi: S0896-6273(18)30191-0 URL pmid: 29673483 |
| [14] | Kawahara H., & Matsui H. (2003). Auditory morphing based on an elastic perceptual distance metric in an interference-free time- frequency representation. International Conference on Acoustics, Speech, and Signal Processing, 2003 (Hong Kong: IEEE) (pp.256-259). |
| [15] |
Keller A. S., Payne L., & Sekuler R. (2017). Characterizing the roles of alpha and theta oscillations in multisensory attention. Neuropsychologia, 99, 48-63. https://doi.org/10.1016/j.neuropsychologia.2017.02.021
doi: S0028-3932(17)30068-4 URL pmid: 28259771 |
| [16] |
Kwon S., Rugg M. D., Wiegand R., Curran T., & Morcom A. M. (2023). A meta-analysis of event-related potential correlates of recognition memory. Psychonomic Bulletin & Review, 30(6), 2083-2105. https://doi.org/10.3758/s13423-023-02309-y
doi: 10.3758/s13423-023-02309-y URL |
| [17] | Mąka S., Chrustowicz M., & Okruszek Ł. (2023). Can we dissociate hypervigilance to social threats from altered perceptual decision-making processes in lonely individuals? An exploration with Drift Diffusion Modeling and event-related potentials. Psychophysiology, 60(12), Article e14406. https://doi.org/10.1111/psyp.14406 |
| [18] |
Maris E., & Oostenveld R. (2007). Nonparametric statistical testing of EEG- and MEG-data. Journal of Neuroscience Methods, 164(1), 177-190. https://doi.org/10.1016/j.jneumeth.2007.03.024
doi: 10.1016/j.jneumeth.2007.03.024 URL pmid: 17517438 |
| [19] | McGinnis E. M., & Keil A. (2011). Selective processing of multiple features in the human brain: Effects of feature type and salience. PLoS One, 6(2), Article e16824. https://doi.org/10.1371/journal.pone.0016824 |
| [20] | Oostenveld R., Fries P., Maris E., & Schoffelen J. M. (2011). FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Computational Intelligence and Neuroscience, 2011, 156869. https://doi.org/10.1155/2011/156869 |
| [21] | Orlandi A., & Proverbio A. M. (2019). Left-hemispheric asymmetry for object-based attention: An ERP study. Brain Sciences, 9(11), Article 315. https://doi.org/10.3390/brainsci9110315 |
| [22] |
Petrov A. A. (2011). Category rating is based on prototypes and not instances: evidence from feedback-dependent context effects. Journal of Experimental Psychology: Human Perception and Performance, 37(2), 336-356. https://doi.org/10.1037/a0021436
doi: 10.1037/a0021436 URL pmid: 21463082 |
| [23] |
Posner M. I., & Keele S. W. (1968). On the genesis of abstract ideas. Journal of Experimental Psychology, 77(3, Pt.1), 353-363. https:// doi.org/10.1037/h0025953
URL pmid: 5665566 |
| [24] |
Ratcliff R., & McKoon G. (2008). The diffusion decision model: Theory and data for two-choice decision tasks. Neural Computation, 20(4), 873-922. https://doi.org/10.1162/neco.2008.12-06-420
doi: 10.1162/neco.2008.12-06-420 URL pmid: 18085991 |
| [25] |
Scholl C. A., Jiang X., Martin J. G., & Riesenhuber M. (2014). Time course of shape and category selectivity revealed by EEG rapid adaptation. Journal of Cognitive Neuroscience, 26(2), 408-421. https://doi.org/10.1162/jocn_a_00477
doi: 10.1162/jocn_a_00477 URL pmid: 24001003 |
| [26] |
Smith J. D. (2002). Exemplar theory’s predicted typicality gradient can be tested and disconfirmed. Psychological Science, 13(5), 437-442. https://doi.org/10.1111/1467-9280.00477
doi: 10.1111/1467-9280.00477 URL |
| [27] |
Sun J., Osth A. F., & Feuerriegel D. (2024). The late positive event-related potential component is time locked to the decision in recognition memory tasks. Cortex, 176, 194-208. https://doi.org/10.1016/j.cortex.2024.04.017
doi: 10.1016/j.cortex.2024.04.017 URL pmid: 38796921 |
| [28] |
Tanaka J. W., Curran T., Porterfield A. L., & Collins D. (2006). Activation of preexisting and acquired face representations: The N250 event-related potential as an index of face familiarity. Journal of Cognitive Neuroscience, 18(9), 1488-1497. https://doi.org/10.1162/jocn.2006.18.9.1488
URL pmid: 16989550 |
| [29] |
Wiecki T. V., Sofer I., & Frank M. J. (2013). HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python. Frontiers in Neuroinformatics, 7: 14. https://doi.org/10.3389/fninf.2013.00014
doi: 10.3389/fninf.2013.00014 URL pmid: 23935581 |
| [30] |
Wu J., Che Z. (2025). The cognitive characteristics and neural mechanisms of multisensory category learning: EEG and drift-diffusion model evidence. Acta Psychologica Sinica, 57(10), 1715-1728. https://doi.org/10.3724/SP.J.1041.2025.1715
doi: 10.3724/SP.J.1041.2025.1715 URL |
| [31] |
Wu J., Li Q., Fu Q., Rose M., & Jing L. (2021). Multisensory information facilitates the categorization of untrained stimuli. Multisensory Research, 35(1), 79-107. https://doi.org/10.1163/22134808-bja10061
doi: 10.1163/22134808-bja10061 URL |
| [32] |
Yuan B., Wang X., Yin J., & Li W. (2023). The role of cross- situational stimulus generalization in the formation of trust towards face: A perspective based on direct and observational learning. Acta Psychologica Sinica, 55(7), 1099-1114. https://doi.org/10.3724/sp.J.1041.2023.01099
doi: 10.3724/SP.J.1041.2023.01099 URL |
| [1] | JIN Tingting, QIAN Yufu, FAN Xinru, WANG Qian, REN Guiqin, LI Weijun. Neural mechanisms underlying the processing of Chinese semantic-pun and homophonic-pun jokes [J]. Acta Psychologica Sinica, 2026, 58(12): 2456-2473. |
| [2] | XIA Ruixue, ZHANG Naiwen, JIANG Yunhe, ZHOU Aibao. The complete self: Shape completeness enhances self-prioritization [J]. Acta Psychologica Sinica, 2026, 58(12): 2631-2652. |
| [3] | LI Linghe, REN Weicong, HAN Haibin, WANG Hanlin. When movement meets beauty: The embodied influence of horizontal movement on facial aesthetic judgment considering gender differences [J]. Acta Psychologica Sinica, 2026, 58(11): 2289-2307. |
| [4] | CHEN Zilong, JI Luyan. Automatic processing of variability in multiple facial expressions: Evidence from visual mismatch responses [J]. Acta Psychologica Sinica, 2025, 57(9): 1553-1571. |
| [5] | SONG Ru, WU Jun, LIU Caixia, LIU Jie, CUI Fang. Is the Bystander Truly Objective? The Moderation of Third-Party Moral Judgment by Perspective Taking in Moral Scenarios [J]. Acta Psychologica Sinica, 2025, 57(6): 1070-1082. |
| [6] | WU Jun, LI Wanchen, YAO Xiaohuan, LIU Jie, CUI Fang. Kindness or fairness: Prosociality and fairness jointly modulate moral judgments [J]. Acta Psychologica Sinica, 2024, 56(11): 1541-1555. |
| [7] | ZHANG Wenyun, ZHUO Shiwei, ZHENG Qianqian, GUAN Yinglin, PENG Weiwei. Autistic traits influence pain empathy: The mediation role of pain-related negative emotion and cognition [J]. Acta Psychologica Sinica, 2023, 55(9): 1501-1517. |
| [8] | YUAN Bo, WANG Xiaoping, YIN Jun, LI Weiqiang. The role of cross-situational stimulus generalization in the formation of trust towards face: A perspective based on direct and observational learning [J]. Acta Psychologica Sinica, 2023, 55(7): 1099-1114. |
| [9] | LI Mei, LI Jin, ZHANG Guanfei, ZHONG Yiping, LI Hong. Influence of social distance and promise levels on trust decisions: An ERPs study [J]. Acta Psychologica Sinica, 2023, 55(11): 1859-1871. |
| [10] | ZHAN Youlong, XIAO Xiao, TAN Qianbao, LI Jin, ZHONG Yiping. Influence of reputational concern and social distance on moral decision-making under the harmful dilemma: Evidence from behavioral and ERPs study [J]. Acta Psychologica Sinica, 2022, 54(6): 613-627. |
| [11] | CHEN Jie, WU Ke, SHI Yupeng, AI Xiaoqing. The relationship between dispositional self-construal and empathy for ingroup and outgroup members’ pain: evidence from ERPs [J]. Acta Psychologica Sinica, 2021, 53(6): 629-638. |
| [12] | TIAN Lumei, YUAN Jingchi, LI Yongmei. Effects of peer presence and self-esteem on adolescent risk-taking behavior: Evidence from an ERP study [J]. Acta Psychologica Sinica, 2018, 50(1): 47-57. |
| [13] | YANG Yaping, XU Qiang, ZHANG Lin, DENG Peizhuang, LIANG Ningjian. Scenes Differing in Spatial Frequencies Affect Facial Expression Processing: Evidence from ERP [J]. Acta Psychologica Sinica, 2015, 47(12): 1433-1444. |
| [14] | WANG Yingying;LIANG Jiuqing;GUO Chunyan. Effects of Emotional Picture Cues on Directed Forgetting Using the Item Method: An ERPs Study at Encoding [J]. Acta Psychologica Sinica, 2014, 46(6): 740-753. |
| [15] | JIANG Jun;XIANG Ling;ZHANG Qinglin;CHEN Antao. Conflict Adaptation Is Independent of Consciousness: Behavioral and ERP Evidence [J]. Acta Psychologica Sinica, 2014, 46(5): 581-592. |
| Viewed | ||||||
|
Full text |
|
|||||
|
Abstract |
|
|||||
