Please wait a minute...
Acta Psychologica Sinica
|
The polytomously scored cognitive diagnosis computerized adaptive testing
CAI Yan; MIAO Ying; TU Dongbo
(School of Psychology of Jiangxi Normal University, Center of Mental Health Education and Research of Jiangxi Normal University, Lab of Psychology and Cognition Science of Jiangxi, Nanchang 330022, China)
Download: PDF(427 KB)   Review File (1 KB) 
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  

Cognitive diagnostic computerized adaptive testing (CD-CAT) purports to combine the strengths of both CAT and cognitive diagnosis. Currently, most CD-CAT researches focus on the dichotomous data. However there are large polytomous data in educational and psychological tests in practice. This paper proposed a new CD-CAT procedure with polytomous score, called as psCD-CAT. The paper focused on two facets: one was to develop the item selection algorithm, parameter estimation, the polytomous cognitive diagnostic model and terminal rules for psCD-CAT; the other one was to discuss the classification accuracy and item usage in psCD-CAT. Monte Carlo simulation was conducted here. Two experimental conditions were simulated: the fixed test length CAT (10, 15 and 20 items respectively) and the variable test length CAT (the post probability of knowledge state was set to 0.75,0.80 and 0.85 respectively). Simulation studies showed: The classification accuracy, test security and test efficiency under psCD-CAT were all acceptable and reasonable. Whenever under fixed or variable length conditions, PS-PWKL and PS-HKL item selection strategies had high classification accuracy, test security and test efficiency. However, PS-KL item selection strategy had low classification accuracy under fixed variable length conditions and had low test security and test efficiency under variable length conditions. Contract to the random item selection, PS-PWKL and PS-HKL algorithm should be improved to control the item exposure. In conclusion, the proposed psCD-CAT by this paper had overcame the shortcomings stemmed from dichotomously scored CD-CAT, thus they might expect a good prospect and application. And it provided a kind of new methods and techniques in cognitive diagnosis, which might extended the applicable area.

Keywords cognitive diagnosis      CD-CAT      polytomously scored      P-DINA model      GP-DINA model     
Corresponding Authors: TU Dongbo, E-mail: tudongbo@aliyun.com    
Issue Date: 25 October 2016
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
CAI Yan
MIAO Ying
TU Dongbo
Cite this article:   
CAI Yan,MIAO Ying,TU Dongbo. The polytomously scored cognitive diagnosis computerized adaptive testing[J]. Acta Psychologica Sinica, 10.3724/SP.J.1041.2016.01338
URL:  
http://journal.psych.ac.cn/xlxb/EN/10.3724/SP.J.1041.2016.01338     OR     http://journal.psych.ac.cn/xlxb/EN/Y2016/V48/I10/1338
[1] LIU Yanlou; XIN Tao; LI Lingqing; TIAN Wei; LIU Xiaoxiao. An improved method for differential item functioning detection in cognitive diagnosis models: An application of Wald statistic based on observed information matrix[J]. Acta Psychologica Sinica, 2016, 48(5): 588-598.
[2] ZHAN Peida; BIAN Yufang; WANG Lijun. Factors affecting the classification accuracy of reparametrized diagnostic classification models for expert-defined polytomous attributes[J]. Acta Psychologica Sinica, 2016, 48(3): 318-330.
[3] ZHAN Peida; CHEN Ping; BIAN Yufang. Using confirmatory compensatory multidimensional IRT models to do cognitive diagnosis[J]. Acta Psychologica Sinica, 2016, 48(10): 1347-1356.
[4] KANG Chunhua; REN Ping; ZENG Pingfei. Nonparametric Cognitive Diagnosis: A Cluster Diagnostic Method  Based on Grade Response Items[J]. Acta Psychologica Sinica, 2015, 47(8): 1077-1088.
[5] TANG Xiaojuan; DING Shuliang; YU Zonghuo. Application of Rough Set Theory in Item Cognitive Attribute Identification[J]. Acta Psychologica Sinica, 2015, 47(7): 950-962.
[6] ZHAN Peida; LI Xiaomin; WANG Wen-Chung; BIAN Yufang; WANG Lijun. The Multidimensional Testlet-Effect Cognitive Diagnostic Models[J]. Acta Psychologica Sinica, 2015, 47(5): 689-701.
[7] LUO Zhaosheng; YU Xiaofeng; GAO Chunlei; LI Yujun; PENG Yafeng;WANG Rui; WANG Yutong. Item Selection Strategies Based on Attribute Mastery Probabilities in CD-CAT[J]. Acta Psychologica Sinica, 2015, 47(5): 679-688.
[8] TU Dongbo; CAI Yan. The Development of CD-CAT with Polytomous Attributes[J]. Acta Psychologica Sinica, 2015, 47(11): 1405-1414.
[9] CAI Yan; TU Dongbo. Extension of Cognitive Diagnosis Models Based on the Polytomous Attributes Framework and Their Q-matrices Designs[J]. Acta Psychologica Sinica, 2015, 47(10): 1300-1308.
[10] WANG Zhuoran; GUO Lei; BIAN Yufang. Comparison of DIF Detecting Methods in Cognitive Diagnostic Test[J]. Acta Psychologica Sinica, 2014, 46(12): 1923-1932.
[11] TU Dongbo;CAI Yan;DAI Haiqi. Comparison and Selection of Five Noncompensatory Cognitive Diagnosis Models Based on Attribute Hierarchy Structure[J]. Acta Psychologica Sinica, 2013, 45(2): 243-252.
[12] CAI Yan;TU Dongbo;DING Shuliang. A Simulation Study to Compare Five Cognitive Diagnostic Models[J]. Acta Psychologica Sinica, 2013, 45(11): 1295-1304.
[13] TU Dong-Bo,CAI Yan,DAI Hai-Qi. A New Method of Q-matrix Validation Based on DINA Model[J]. , 2012, 44(4): 558-568.
[14] LUO Fen,DING Shu-Liang,WANG Xiao-Qing. Dynamic and Comprehensive Item Selection Strategies for Computerized Adaptive Testing Based on Graded Response Model[J]. , 2012, 44(3): 400-412.
[15] TU Dong-Bo;CAI Yan;DAI Hai-Qi;DING Shu-Liang. A New Multiple-Strategies Cognitive Diagnosis Model: the MSCD Method[J]. Acta Psychologica Sinica, 2012, 44(11): 1547-1553.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Acta Psychologica Sinica
Support by Beijing Magtech