ISSN 0439-755X
CN 11-1911/B
主办:中国心理学会
   中国科学院心理研究所
出版:科学出版社

心理学报 ›› 2016, Vol. 48 ›› Issue (10): 1338-1346.doi: 10.3724/SP.J.1041.2016.01338

• 论文 • 上一篇    下一篇

多级评分的认知诊断计算机化适应测验

蔡 艳; 苗 莹; 涂冬波   

  1. (江西师范大学心理学院, 江西师范大学心理健康教育研究中心, 江西省心理与认知科学重点实验室, 南昌 330022)
  • 收稿日期:2015-08-05 发布日期:2016-10-25 出版日期:2016-10-25
  • 通讯作者: 涂冬波, E-mail: tudongbo@aliyun.com
  • 基金资助:

    国家自然科学基金(31300876, 31100756, 31160203, 31360237, 31660278), 江西省社会科学规划项目重点项目(13JY01), 江西省高校人文社科项目(XL1507, XL1508), 江西省教育科学规划项目(12YB088, 13YB029), 江西师范大学青年英才培育资助计划等课题资助。

The polytomously scored cognitive diagnosis computerized adaptive testing

CAI Yan; MIAO Ying; TU Dongbo   

  1. (School of Psychology of Jiangxi Normal University, Center of Mental Health Education and Research of Jiangxi Normal University, Lab of Psychology and Cognition Science of Jiangxi, Nanchang 330022, China)
  • Received:2015-08-05 Online:2016-10-25 Published:2016-10-25
  • Contact: TU Dongbo, E-mail: tudongbo@aliyun.com

摘要:

本文在0-1评分的CD-CAT基础上, 拓展出了适合多级评分CD-CAT (psCD-CAT)的认知诊断模型及选题策略, 为实现多级评分CD-CAT提供了方法支持。Monte Carlo模拟实验结果表明:本文拓展的多级评分CD-CAT具有较理想的属性诊断正确率及测验效率和题库安全性, 可以用于多级评分数据的CD-CAT; 模拟实验还表明, 整体来看PS-PWKL和PS-HKL两种选题策略具有较高属性判准率、题库安全性和高测验效率, 且均优于PS-KL选题策略。总之, 本研究对于进一步拓展CD-CAT在实践中的应用提供了认知诊断模型与选题策略等。

关键词: 认知诊断, CD-CAT, 多级评分, P-DINA模型, GP-DINA模型

Abstract:

Cognitive diagnostic computerized adaptive testing (CD-CAT) purports to combine the strengths of both CAT and cognitive diagnosis. Currently, most CD-CAT researches focus on the dichotomous data. However there are large polytomous data in educational and psychological tests in practice. This paper proposed a new CD-CAT procedure with polytomous score, called as psCD-CAT. The paper focused on two facets: one was to develop the item selection algorithm, parameter estimation, the polytomous cognitive diagnostic model and terminal rules for psCD-CAT; the other one was to discuss the classification accuracy and item usage in psCD-CAT. Monte Carlo simulation was conducted here. Two experimental conditions were simulated: the fixed test length CAT (10, 15 and 20 items respectively) and the variable test length CAT (the post probability of knowledge state was set to 0.75,0.80 and 0.85 respectively). Simulation studies showed: The classification accuracy, test security and test efficiency under psCD-CAT were all acceptable and reasonable. Whenever under fixed or variable length conditions, PS-PWKL and PS-HKL item selection strategies had high classification accuracy, test security and test efficiency. However, PS-KL item selection strategy had low classification accuracy under fixed variable length conditions and had low test security and test efficiency under variable length conditions. Contract to the random item selection, PS-PWKL and PS-HKL algorithm should be improved to control the item exposure. In conclusion, the proposed psCD-CAT by this paper had overcame the shortcomings stemmed from dichotomously scored CD-CAT, thus they might expect a good prospect and application. And it provided a kind of new methods and techniques in cognitive diagnosis, which might extended the applicable area.

Key words: cognitive diagnosis, CD-CAT, polytomously scored, P-DINA model, GP-DINA model