ISSN 1671-3710
CN 11-4766/R

心理科学进展 ›› 2022, Vol. 30 ›› Issue (6): 1367-1376.doi: 10.3724/SP.J.1042.2022.01367

• 研究方法 • 上一篇    下一篇

国内管理心理实验中的操纵检验: 现状、问题与建议

卫旭华, 汪光炜(), 陈义   

  1. 兰州大学管理学院, 兰州 730000
  • 收稿日期:2021-08-09 出版日期:2022-06-15 发布日期:2022-04-26
  • 通讯作者: 汪光炜
  • 基金资助:

Manipulation checks in the managerial psychology experiment in China: Current status, problems, and suggestions

WEI Xuhua, WANG Guangwei(), CHEN Yi   

  1. School of Management, Lanzhou University, Lanzhou 730000, China
  • Received:2021-08-09 Online:2022-06-15 Published:2022-04-26
  • Contact: WANG Guangwei


虽然操纵检验是保证实验构念效度的重要方式, 但国内管理心理学者对其方法层面的探讨较少。基于此, 本研究在归纳了操纵检验主要用途的基础上, 对国内2020年《心理学报》、《心理科学》、《管理世界》、《南开管理评论》这4本期刊中涉及管理心理实验的49篇论文、144项实验进行了编码分析, 从操纵检验的关键设计环节总结了国内管理心理领域操纵检验的使用现状、问题及其应对策略。研究发现, 国内操纵检验实施形式单一, 以自我报告式操纵检验为主, 很少关注辨别式操纵检验和指导式操纵检验, 且对操纵检验的位置设计、实施时机和分析策略重视度不够。未来研究者应当注重通过非干预形式减少操纵检验对实验进程的干扰, 实施误差控制策略排除无效检验和竞争性解释, 根据操纵检验特性决定其在实验材料中的位置, 借助事前和事后操纵检验实现检验时机的灵活性, 开展操纵强度和中介分析提升实验内外部效度, 从而提升实验操纵检验的规范性。

关键词: 管理心理实验, 直接操纵检验, 辨别式操纵检验, 指导式操纵检验


Manipulation checks are important method to ensure the construct validity of managerial psychology experiment, which are also regarded as the basic technology of modern psychology experiments. Although manipulation checks have many advantages and have received widespread attention, current experimental method in managerial psychology literatures mainly focus on the overall experiment design and the strategy of data analysis, rarely investigating the details of manipulation checks design. Although some psychological research published in top international journals has discussed the problem of construct validity and the statistical analysis of manipulation checks, these limited studies have not carried out an integrated review from the key design process of manipulation checks and provided targeted coping strategies. This may lead researchers to undertake manipulation checks designs without solid theoretical support, and even conduct subjective design based on incomplete understanding and draw biased experimental conclusions.
In order to effectively improve the normativity of manipulation checks in the managerial psychology field in China, this study summarized the functions of direct manipulation checks, discriminant manipulation checks and instructional manipulation checks, and then coded 144 experiments drawn from 49 studies in the field of managerial psychology which were published in 4 top-tier journals in 2020 (i.e., Acta Psychologica Sinica, Journal of Psychological Science, Management World, and Nankai Business Review). The present study analyzed the current status, problems and coping strategies of manipulation checks in the managerial psychology field in China from the perspective of the implementation form, the error control, the location choice, the implementation timing and the analytic strategy.
Results showed that the application of manipulation checks in the managerial psychology field were not normative enough in China. Specifically, the way to implement manipulation checks appeared monistic with self-report dominating among these experiments. In terms of error control, many studies did not use maturity measurement scale, and seldomly employed new manipulation checks strategies (e.g., discriminant manipulation checks and instructional manipulation checks) to exclude competitive explanations and invalid experimental samples. For the choice of location, only a few managerial psychology studies paid attention to the influence of manipulation checks location on experiments, and most managerial psychology experiments placed manipulation checks in front of dependent variable. Furthermore, in the aspect of the implementation timing, most managerial psychology experiments completed manipulation checks during the experiment process, and manipulation checks were less implemented in the form of pre manipulation checks (e.g., pilot experiment) and post manipulation checks (e.g., qualitative coding). Finally, as for the strategy of experimental data analysis, the utilization rate of manipulation checks data was low. For example, most managerial psychology studies only focused on analysis of variance of the independent variable between groups and ignored the strength and mediation analysis strategy of the experimental manipulation.
Manipulation checks without enough normativity cannot strongly guarantee the construct validity of experiment and may even interference the experimental process and get incorrect conclusions. To avoid it, future managerial psychology research should pay attention to the application of non-interventional forms to reduce the interference of manipulation checks on the experimental process. Besides, implementing error control strategies should be advocated to eliminate invalid data and competitive explanations. At the same time, the present study suggest that researchers should consider the characteristics of manipulation checks when they decide the appropriate position of manipulation checks included in the experiment material. Researchers are also encouraged to use pre and post manipulation checks to ensure flexibility. In the data analysis phase, we recommend researchers use manipulation strength and mediation analysis to guarantee the internal and external validity of the managerial psychology experiment. By doing so, this study expects the normativity of manipulation checks will be improved to a great extent.

Key words: managerial psychology experiment, direct manipulation checks, discriminant manipulation checks, instructional manipulation checks