Please wait a minute...
   2012, Vol. 44 Issue (4) : 558-568     DOI:
|
A New Method of Q-matrix Validation Based on DINA Model
TU Dong-Bo;CAI Yan;DAI Hai-Qi
(School of Psychology, Jiangxi Normal University, Nanchang 330022, China)
Download: PDF(329 KB)  
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  Recently more and more attentions were paid on cognitive diagnosis (CD). The recognition of Q matrix was the basis and proposition of CD, and it was the only information media about cognitive attributes and test items. Only if it was recognized correctly, then the following cognitive analysis might be reliable.
This paper developed a new modification method of Q matrix (called g method) based on DINA model. The method could detect and modify the mistakes on Q matrix that could make the Q matrix rationally and promote the correct match ratio of CD.
Monte Carlo simulation method was use here, and some comparisons with western similar studies were done. Findings showed:
(1) Under any response slip probability (5%, 10%, 15%) context, when the critical value of parameters s and g was set to be 0.2, 0.25 or 0.3, g method could modify the mistakes of Q matrix efficiently. When Q matrix was recognized correctly, no modification will be done by g method. These indicated that g method could work well on recognition and modification on Q matrix whether it has mistakes or not.
(2) Compared to the similar western studies, the correct modification ratio of g method was relatively great and similar with the consequences of d method suggested by de la Tarre (2008). But g method was simpler than d method.
(3) The g method could not only rectify the mistakes of Q matrix efficiently but also promote the correct match ratio of CD. Especially the correct match ratio of PMR increased greater than 40% which was a wonderful work.
Keywords cognitive diagnosis      Q-matrix validation      DINA model      the g method     
Corresponding Authors: TU Dong-Bo   
Issue Date: 28 April 2012
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
TU Dong-Bo
CAI Yan
DAI Hai-Qi
Cite this article:   
TU Dong-Bo,CAI Yan,DAI Hai-Qi. A New Method of Q-matrix Validation Based on DINA Model[J]. , 2012, 44(4): 558-568.
URL:  
http://journal.psych.ac.cn/xlxb/EN/     OR     http://journal.psych.ac.cn/xlxb/EN/Y2012/V44/I4/558
[1] LIU Yanlou; XIN Tao; LI Lingqing; TIAN Wei; LIU Xiaoxiao. An improved method for differential item functioning detection in cognitive diagnosis models: An application of Wald statistic based on observed information matrix[J]. Acta Psychologica Sinica, 2016, 48(5): 588-598.
[2] ZHAN Peida; BIAN Yufang; WANG Lijun. Factors affecting the classification accuracy of reparametrized diagnostic classification models for expert-defined polytomous attributes[J]. Acta Psychologica Sinica, 2016, 48(3): 318-330.
[3] ZHAN Peida; CHEN Ping; BIAN Yufang. Using confirmatory compensatory multidimensional IRT models to do cognitive diagnosis[J]. Acta Psychologica Sinica, 2016, 48(10): 1347-1356.
[4] CAI Yan; MIAO Ying; TU Dongbo. The polytomously scored cognitive diagnosis computerized adaptive testing[J]. Acta Psychologica Sinica, 2016, 48(10): 1338-1346.
[5] KANG Chunhua; REN Ping; ZENG Pingfei. Nonparametric Cognitive Diagnosis: A Cluster Diagnostic Method  Based on Grade Response Items[J]. Acta Psychologica Sinica, 2015, 47(8): 1077-1088.
[6] TANG Xiaojuan; DING Shuliang; YU Zonghuo. Application of Rough Set Theory in Item Cognitive Attribute Identification[J]. Acta Psychologica Sinica, 2015, 47(7): 950-962.
[7] ZHAN Peida; LI Xiaomin; WANG Wen-Chung; BIAN Yufang; WANG Lijun. The Multidimensional Testlet-Effect Cognitive Diagnostic Models[J]. Acta Psychologica Sinica, 2015, 47(5): 689-701.
[8] YU Xiaofeng; LUO Zhaosheng; GAO Chunlei; LI Yujun; WANG Rui; WANG Yutong. An Item Attribute Specification Method Based On the Likelihood D2 Statistic[J]. Acta Psychologica Sinica, 2015, 47(3): 417-426.
[9] YU Xiaofeng; LUO Zhaosheng; QIN Chunying; GAO Chunlei; LI Yujun. Joint Estimation of Model Parameters and Q-Matrix Based on Response Data[J]. Acta Psychologica Sinica, 2015, 47(2): 273-282.
[10] CAI Yan; TU Dongbo. Extension of Cognitive Diagnosis Models Based on the Polytomous Attributes Framework and Their Q-matrices Designs[J]. Acta Psychologica Sinica, 2015, 47(10): 1300-1308.
[11] GUO Lei; ZHENG Chanjin; BIAN Yufang. Exposure Control Methods and Termination Rules in Variable-Length Cognitive Diagnostic Computerized Adaptive Testing[J]. Acta Psychologica Sinica, 2015, 47(1): 129-140.
[12] WANG Zhuoran; GUO Lei; BIAN Yufang. Comparison of DIF Detecting Methods in Cognitive Diagnostic Test[J]. Acta Psychologica Sinica, 2014, 46(12): 1923-1932.
[13] TU Dongbo;CAI Yan;DAI Haiqi. Comparison and Selection of Five Noncompensatory Cognitive Diagnosis Models Based on Attribute Hierarchy Structure[J]. Acta Psychologica Sinica, 2013, 45(2): 243-252.
[14] CAI Yan;TU Dongbo;DING Shuliang. A Simulation Study to Compare Five Cognitive Diagnostic Models[J]. Acta Psychologica Sinica, 2013, 45(11): 1295-1304.
[15] TU Dong-Bo;CAI Yan;DAI Hai-Qi;DING Shu-Liang. A New Multiple-Strategies Cognitive Diagnosis Model: the MSCD Method[J]. Acta Psychologica Sinica, 2012, 44(11): 1547-1553.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Acta Psychologica Sinica
Support by Beijing Magtech