ISSN 0439-755X
CN 11-1911/B
主办：中国心理学会
　　　中国科学院心理研究所
出版：科学出版社

心理学报 ›› 2016, Vol. 48 ›› Issue (8): 1037-1046.doi: 10.3724/SP.J.1041.2016. 01037

• 论文 • 上一篇    下一篇

CD-MST初始阶段模块组建方法比较

高椿雷1,2 ；罗照盛1； 喻晓锋1； 彭亚风1； 郑蝉金1   

  1. (1江西师范大学心理学院; 2江西师范大学初等教育学院, 南昌 330022)
  • 收稿日期:2015-09-28 发布日期:2016-08-25 出版日期:2016-08-25
  • 通讯作者: 郑蝉金, E-mail: russelzheng@gmail.com
  • 基金资助:

    国家自然科学基金(31500909), 2014年江西省高校人文社会科学一般项目(XL1403), 2015年江西省高校人文社会科学项目(XL1509), 江西省研究生创新基金(YC2015-B025)资助。

The comparison of initial stage module assemble methods of CD-MST

GAO Chunlei1,2; LUO Zhaosheng1; YU Xiaofeng1; PENG Yafeng1; ZHENG Chanjin1   

  1. (1 School of Psychology, Jiangxi Normal University, Nanchang 330022, China) (2 Elementary Education College, Jiangxi Normal University, Nanchang 330022, China)
  • Received:2015-09-28 Online:2016-08-25 Published:2016-08-25
  • Contact: ZHENG Chanjin, E-mail: russelzheng@gmail.com

PDF (PC)

1165

摘要：

具有认知诊断功能的计算机化多阶段测验(CD-MST)是CDA和MST相结合的一种测验方式。由于CD-MST自适应频次较少, 初始阶段模块组建会影响整个测验的判准率。借鉴CD-CAT初始项目选取方法, 根据CDA和MST自身特点, 提出了7种CD-MST初始阶段模块组建方法, 分别是随机法、选题策略法、R*矩阵法、CTTID法、CDI法、CTTIDR*法和CDIR*法。采用模拟研究对不同项目质量下7种方法的判准率进行了比较。研究结果表明, 当初始阶段结束时, 包含R*矩阵的方法判准率显著高于其他方法, 尤其是CTTIDR*法; 整个测验结束时, CTTIDR*法较其他方法仍然有优势, CDIR*法和R*矩阵法结果较为接近。选题策略法在初始阶段结束时判准率较低, 甚至低于随机法, 整个测验结束时, 判准率同CDIR*法和R*矩阵法持平。4种项目质量对判准率影响较大, HD-HV题库下判准率最高, HD-LV次之, LD-HV较差, LD-LV最差。

关键词: 认知诊断评价, 计算机化多阶段测验, 具有认知诊断功能的计算机化多阶段测验, 初始阶段模块组建方法

Abstract:

Cognitive Diagnostic Multistage Testing (CD-MST) is a new testing mode which combines MST with CDA. It has some advantages, such as improving instruction, allowing administers to check the pre-assembled test forms, allowing the examinee to review and revise answers. The initial stage module assemble methods is an important part for CD-MST. It is presented seven initial stage module assemble methods, they are Random method, Item Selection method, R* Matrix method, CTTID method, CDI method, CTTIDR* method and CDIR* method. 1) Random method means that select first stage items from item bank randomly, this method does not consider item parameters and attributes. It is easy and fast.2) Item selection method is first to randomly assign a knowledge state to examinee, and then select the initial stage items according to item selection indices (such as PWKL, SHE). 3) R* matrix method is to select initial items from R-matrix. 4) CTTID method means that select high discriminatory items for the first stage. In DINA model, high discriminatory items are the items slipping and guessing parameters smaller.5) CDI method is presented by Henson and Douglas (2005), it’s another item discrimination index, it considers item parameter and attribute.6) Item parameter and R matrix are the important elements which can influence the efficiency of testing, so here we consider discrimination and R matrix simultaneously to select first stage items, CTTIDR* method and 7) CDIR* method are from this consideration. A simulation research was used to verify these methods of CD-MST. CDM was DINA model, the number of examinee was 3000, item bank was 1240, the number of attributes was 5, stage number of CD-MST was 3. PCCR and ACCR were the evaluation indices. The quality of item bank was a contributory factor. The results showed that after the initial stage, under each of the quality of item banks, the PCCR of the methods with R* matrix were higher than others. When the tests were finished, CTTIDR* method was also higher than others, it had obvious advantage. CD-MST is an efficient application of MST in CDA. It is necessary to study many issues of CD-MST, the initial stage module assemble method is one of them. Some of the seven methods we presented here are effectively and exactly. These methods can also extend to CD-CAT.

Key words: CDA, MST, CD-MST, initial stage module assemble methods