ISSN 0439-755X
CN 11-1911/B
主办:中国心理学会
   中国科学院心理研究所
出版:科学出版社

• •    

基于变点分析法的后期随机作答探测:迭代净化的视角

李雨欣, 陈琦鹏, 周曌, 李中权   

  1. 南京大学社会学院心理系, 江苏 210023 中国
    The University of AlabamaEducational Research Program, Educational Studies in Psychology, Research Methodology, and Counseling, 江苏 35487 美国
  • 收稿日期:2026-03-18 修回日期:2026-08-29 接受日期:2026-09-29
  • 基金资助:
    国家自然科学基金(W2411065,72571132)

Detecting Back Random Responding with Change Point Analysis: An Iterative Purification Perspective

Yuxin Li, Qipeng Chen, Zhao Zhou, Zhongquan Li   

  1. Department of Psychology, Nanjing University 210023, China
    Educational Studies in Psychology, Research Methodology, and Counseling, University of Alabama 35487, United States
  • Received:2026-03-18 Revised:2026-08-29 Accepted:2026-09-29
  • Supported by:
    National Natural Science Foundation of China(W2411065,72571132)

摘要: 后期随机作答是心理与教育测验中一种常见的异常作答形式,表现为被试在测验前半段正常作答,但在测验后期转向随机或无规律作答。变点分析法(Change Point Analysis, CPA)可通过识别作答序列中的变化点检测此类异常反应,但现有研究多基于项目参数已知的理想条件。实际应用中,项目参数多由作答数据估计,若数据中包含异常反应,可能产生有偏的参数估计,进而影响CPA的检测表现。为此,本研究在传统CPA框架中引入迭代净化程序,通过逐轮识别异常反应、净化作答数据并重新估计项目参数,考察其在项目参数未知条件下的应用效果。模拟研究表明,迭代净化能够提高CPA统计量对后期随机作答的检出能力,并降低异常反应污染对变点定位和项目参数估计的影响。实证分析进一步表明,该方法可为真实测验数据中的异常作答筛查和数据质量评估提供参考。

关键词: 个人拟合, 变点分析法, 迭代净化

Abstract: Back random responding (BRR) is a common form of aberrant responding in psychological and educational testing. It occurs when examinees respond normally during the earlier part of a test but shift to random or irregular responding in the later part. Such response behavior may contaminate item and person parameter estimation and threaten the validity of subsequent measurement inferences. Change point analysis (CPA) provides a useful framework for detecting this type of response change because it can identify not only whether an examinee shows aberrant responding but also where the abnormal change begins in the response sequence. However, most existing CPA applications assume known item parameters. In practical testing situations, item parameters are often unknown and must be estimated from response data that may already contain aberrant responses. Biased parameter estimation may therefore impair CPA performance, reduce statistical power, inflate Type I error rates, and weaken the accuracy of change-point localization. To address this issue, the present study incorporated an iterative purification procedure into the CPA framework. The procedure repeatedly identifies potentially aberrant responses, removes the suspected contaminated responses, and re-estimates item parameters, with the aim of reducing the influence of aberrant responses on parameter estimation and improving CPA performance under unknown-parameter conditions. This study combined simulation research with an empirical application. In the simulation study, both dichotomous and polytomous response data were generated under unidimensional item response theory models. Normal responses were generated using the two-parameter logistic model for dichotomous items and the graded response model for polytomous items, whereas back random responding was generated using a hybrid model with a latent change point. The manipulated factors included test length, the proportion of aberrant respondents, and the distribution of change-point locations. Three conventional CPA statistics, namely L_max, W_max, and S_max, were compared with their iterative-purification versions. The evaluation criteria included statistical power, Type I error rate, change-point localization accuracy, and item parameter recovery. In the empirical study, the proposed method was applied to a real questionnaire dataset to examine its practical utility in identifying potentially aberrant response patterns. The simulation results showed that, under unknown-parameter conditions, the performance of conventional CPA statistics deteriorated as the proportion of aberrant respondents increased. Specifically, statistical power decreased, Type I error rates tended to deviate from the nominal level, change-point localization became less accurate, and item parameter recovery worsened. After iterative purification was introduced, the three CPA statistics generally showed higher statistical power and more acceptable Type I error control. They also produced smaller change-point localization errors and improved item parameter recovery, as reflected by reduced bias and RMSE. These improvements were observed under both dichotomous and polytomous scoring conditions, with overall detection performance being more favorable for polytomous data. The empirical results further showed that the purified CPA statistics identified more potentially aberrant respondents than the conventional statistics. After removing respondents flagged by the CPA statistics, reliability indices of the scale increased to varying degrees, providing additional evidence for the practical value of the proposed approach in data quality control. In conclusion, incorporating iterative purification into the CPA framework is an effective strategy for detecting BRR when item parameters are unknown and response data may be contaminated. The proposed approach improves not only aberrant response detection but also change-point localization and item parameter recovery. This study extends iterative purification from traditional person-fit statistics to CPA-based methods and provides a useful tool for response quality assessment, aberrant response screening, and measurement diagnosis in psychological and educational testing.

Key words: person fit, change point analysis, iterative purification