Please wait a minute...
心理学报
  论文 本期目录 | 过刊浏览 | 高级检索 |
基于属性多级化的认知诊断计算机化自适应测验设计与实现
涂冬波;蔡艳
(江西师范大学心理学院, 江西省心理与认知科学重点实验室, 南昌 330022)
The Development of CD-CAT with Polytomous Attributes
TU Dongbo; CAI Yan
(School of Psychology of Jiangxi Normal University, Lab of psychology and cognition science of JiangXi, Nanchang 330022, China)
全文: PDF(464 KB)   评审附件 (1 KB) 
输出: BibTeX | EndNote (RIS)      
摘要 

本研究在传统CD-CAT的基础上进行拓展, 开发设计了可以处理属性多级化的CD-CAT (记为pCD-CAT), 而且当测验所有属性的水平数Lk = 2时则pCD-CAT可简化为CD-CAT, 因此传统CD-CAT是本研究设计开发pCD-CAT的一个特例。Monte Carlo模拟实验结果表明:基于属性多级化框架下设计的pCD-CAT具有较好的诊断正确率、题库安全性和较高的测验效率, 弥补了传统CD-CAT不足; 当属性多级化时, 若采用传统CD-CAT方法, 则诊断正确率很不理想(属性模式判准不到30%), 表明传统CD-CAT在属性多级化测验情景时不适宜, 而本文设计的pCD-CAT是一种不错的选择(属性模式判准高达80%以上)。总之, 本研究对于进一步拓展CD-CAT在实践中的应用提供了新方法和新技术支持。

服务
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章
涂冬波
蔡艳
关键词 pCD-CAT属性多级化认知诊断计算化自应用测验PA-RUM    
Abstract

 

Cognitive diagnostic computerized adaptive testing (CD-CAT) purports to combine the strengths of both CAT and cognitive diagnosis. The attributes in CD-CAT have been supposed to be dichotomous, “0” represents non-master for examinee and non-measurement for item while “1” represents master for examinee and measurement for item. But recently, polytomous attribute framework has been proposed by some studies (Karelitz, 2004; de la Torre, et al., 2010; Chen, et al., 2013). Based on the conventional computerized adaptive testing for cognitive diagnosis with dichotomous attributes, this study developed a new CD-CAT with polytomous attributes, called pCD-CAT, which is adaptive to polytomous or ordered category attributes framework.
During the procedure, two key parts were involved in the pCD-CAT. One was parameters estimation. Here the cognitive diagnosis model with polytomous attributes was employed to estimate the individual’s polytomous knowledge states with maximum likelihood estimator (MLE) algorithm. Another was the item selection strategy. In this paper, the PAKL and PAPWKL methods based on polytomous attributes were developed and implied to select items adaptively from item pool.
Three Monte Carlo simulation studies with different experimental conditions were conducted here, which mainly focused on the performance of the proposed pCD-CAT by this paper. These experimental conditions were the fixed test length CAT (15, 20 and 25 items respectively), the variable test length CAT (the post probability of knowledge state is 0.75,0.80 and 0.85 respectively) and the compare between pCD-CAT and the conventional dichotomous CD-CAT, respectively. There studies showed: The classification accuracy, test security and test efficiency under pCD-CAT were all acceptable and reasonable. The PA-KL item selection strategy had low classification, test security and test efficiency, which indicated that PA-KL was unfit to the pCD-CAT. However PA-PWKL and PA-HKL item selection strategies had high classification accuracy, test security and test efficiency. In addition, while using conventional CD-CAT to fit the pCD-CAT with polytomous attributes, the PMA (attribute pattern match ration) was less than 30% and the test security indexes (e.g. item exposure and test overlap) were poorer than the pCD-CAT. All above results indicated that the conventional CD-CAT should not be employed to fit the polytomous attributes, while the method proposed by this paper is a good choose.
All in all, the pCD-CAT overcame the shortcomings stemmed from dichotomous CD-CAT, thus they might expect a good prospect and application. And it provided a kind of new methods and techniques in cognitive diagnosis, which might extended the applicable area.
Key wordspCD-CAT    Polytomous attributes    CD-CAT    PA-R-RUM
收稿日期: 2014-10-27      出版日期: 2015-11-25
基金资助:

国家自然科学基金(31100756, 31300876, 31160203, 31360237), 江西省社会科学规划项目重点项目(13JY01), 江西省教育科学规划项目(12YB088, 13YB029), 高等院校博士点基金项目(20123604120001), 江西师范大学青年英才培育资助计划, 东北师范大学应用统计教育部重点实验室开放课题(130026509)资助。

通讯作者: 蔡艳, E-mail: cy1979123@aliyun.com   
引用本文:   
涂冬波;蔡艳. 基于属性多级化的认知诊断计算机化自适应测验设计与实现[J]. 心理学报, 10.3724/SP.J.1041.2015.01405.
TU Dongbo; CAI Yan. The Development of CD-CAT with Polytomous Attributes. Acta Psychologica Sinica, 2015, 47(11): 1405-1414.
链接本文:  
http://journal.psych.ac.cn/xlxb/CN/10.3724/SP.J.1041.2015.01405      或      http://journal.psych.ac.cn/xlxb/CN/Y2015/V47/I11/1405
No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
版权所有 © 《心理学报》编辑部
本系统由北京玛格泰克科技发展有限公司设计开发  技术支持:support@magtech.com.cn