ISSN 0439-755X
CN 11-1911/B
主办：中国心理学会
　　　中国科学院心理研究所
出版：科学出版社

心理学报 ›› 2015, Vol. 47 ›› Issue (12): 1511-1519.doi: 10.3724/SP.J.1041.2015.01511

• 论文 • 上一篇    下一篇

基于CD-CAT的多策略RRUM模型及其选题方法开发

戴步云1;张敏强1,2;焦璨3;黎光明1,2;朱华伟4;张文怡5   

  1. (1华南师范大学心理学院/心理应用研究中心, 广州 510631) (2广东省心理学会, 广州 510631)
    (3深圳大学心理与社会学院, 深圳 518060) (4广州市教育研究院, 广州 510030) (5暨南大学管理学院, 广州 510632)
  • 发布日期:2015-12-25 出版日期:2015-12-25
  • 通讯作者: 焦璨, E-mail: jiao_can@qq.com 张敏强, E-mail: zhangmq1117@qq.com
  • 基金资助:

    广州市基础教育学业质量监测系统项目(GZIT2013-ZB0465)、国家社会科学基金“十二五”规划教育学一般课题(BHA130053)和2014年国家自然科学基金面上项目(31470050)。

Item Selection Using the Multiple-Strategy RRUM Based on CD-CAT

DAI Buyun1; ZHANG Minqiang1,2; JIAO Can3; LI Guangming1,2; ZHU Huawei4; ZHANG Wenyi5   

  1. (1 Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China)
    (2 Guangdong Psychological Association, Guangzhou 510631, China) (3 College of Psychology and Sociology,
    Shenzhen University, Shenzhen 518060, China) (4 Guangzhou Institute of Educational Research, Guangzhou 510030, China)
    (5 Management School, Jinan University, Guangzhou 510632, China)
  • Online:2015-12-25 Published:2015-12-25
  • Contact: JIAO Can, E-mail: jiao_can@qq.com ZHANG Wenyi, E-mail: zhangmq1117@qq.com

PDF (PC)

1022

摘要：

在有多种解题策略的认知诊断问题情境中, 用每个Q矩阵表示一种解题策略, 由此将单策略认知诊断RRUM模型拓广为多策略RRUM模型(MS-RRUM)。随后, 在应用MS-RRUM模型的CD-CAT中开发了适用于多策略情境的MAP参数估计法和多策略香农熵(MSSHE)选题法。将MSSHE选题法与随机选题法分别在不同属性数量、不同测验长度下进行比较, 结果发现前者对被试的策略和认知状态判准率都显著优于后者, 而且都很理想。这样就顺利实现了在CD-CAT做策略诊断的目标。

关键词: 多策略CD-CAT, 选题方法, 多策略RRUM模型, 多策略香农熵选题法

Abstract:

Cognitive diagnostic computerized adaptive testing (CD-CAT) is an application of cognitive diagnostic testing (CDT) on the computerized adaptive testing (CAT) platform. CD-CAT can provide information on the specific content areas in which a participant needs the most specific help, and it is typically engineered to tailor the test to each participant’s trait level and thus has high efficiency. The search for the best item selection method is currently one of the most pressing issues in the field of CD-CAT research. Besides, studies on CD-CAT have to address the issue on the number of testing strategies to employ: either all participants use the same strategy, or different participants use different strategies. In practice, for some tasks, all participants use the same strategy; whereas for other tasks, different participants use different strategies to solve the problem. Because cognitive strategy aptitudes (or cognitive structures) vary among participants, each strategy requires different attributes. For the latter type of tasks, a participant’s strategy must be identified before his/her knowledge state (KS, i.e., attribute mastery pattern) can be diagnosed. Strategy diagnosis procedures have not been explored in studies on CD-CAT.

Based on the reduced reparameterized unified model (RRUM) and independence attributes, under different lengths of fixed-length CD-CAT and with various numbers of knowledge attributes, using the maximum a posteriori (MAP), the present study explored the use of the multiple-strategy RRUM (MS-RRUM) and the item selection method in the context of multiple strategies. The MS-RRUM extended the traditional single-strategy RRUM by constructing M different Q-matrices. In the MS-RRUM, each strategy for each item involved a set of parameters, including one baseline parameter and several penalty parameters. The MAP method was then generalized to the multiple-strategy context. An item selection method that fitted the multiple-strategy context, named as the multiple-strategy SHE (MSSHE), was proposed here. When a participant responded to an item, the system estimated the participant’s strategy according to his/her item response vector and then estimated the participant’s KS using the selected strategy. The next item was then selected via the MSSHE method. Using the MS-RRUM along with varying numbers of attributes and test lengths, the strategy and KS recoveries of the MSSHE and the random method were systematically compared.
Results showed that the MSSHE method exhibited excellent strategy and KS estimations, and it was superior to the random method. Besides, when the test was short, the advantage of the MSSHE was more obvious in both strategy estimation and KS estimation; when the number of attributes was relative large, the advantage of the MSSHE was more obvious in KS estimation. Therefore, (1) the MS-RRUM is feasible and can be used in the CD-CAT context; (2) the MAP method, when extended to the multiple-strategy context, can successfully estimate participants’ strategies and KSs; (3) when CD-CAT is applied to the MS-RRUM, the proposed MSSHE method is feasible and efficient in item selection.
This study is the first to apply CD-CAT in a multiple-strategy context, providing more sufficient diagnostic information. Furthermore, the proposed method of MAP in the multiple-strategy context makes parameter estimation easier and is time-saving, and the proposed MSSHE method makes item selection efficient and saves item bank. Overall, this study serves to facilitate the implantation of multiple strategies in CD-CAT. Further studies are suggested to examine the performance of these approaches under other conditions (i.e., using other cognitive diagnostic models, attribute hierarchical structures and variable-length CD-CAT settings).

Key words: Multiple-strategy Cognitive diagnostic computerized adaptive testing, item selection method, Multiple-strategy RRUM, Multiple-strategy SHE