Please wait a minute...
Acta Psychologica Sinica
|
Joint Estimation of Model Parameters and Q-Matrix Based on Response Data
YU Xiaofeng1,2; LUO Zhaosheng1; QIN Chunying2; GAO Chunlei1; LI Yujun1
(1 School of Psychology, Jiangxi Normal University, Nanchang 330022, China) (2 Computer Department, Bozhou Normal College, Bozhou 236800, China)
Download: PDF(470 KB)   Review File (1 KB) 
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  

Q-matrix is an important component of cognitive diagnostic assessment, which represents the item-attribute relationships. Cognitive diagnostic assessment infers attribute mastery patterns of respondents in the testing field based on item responses. Item responses in the assessment are observable, but respondents attribute mastery patterns are potential, not observable. Q-matrix plays the role of a bridge in cognitive diagnostic assessment. Therefore, Q-matrix impact the accuracy of cognitive diagnostic assessment greatly. Research on the effect of parameter estimation and classification accuracy caused by the error in Q-matrix already existed, and it turned out that Q-matrix gotten from expert definition or experience was more easily subject to be affected by subjective factors, lead to a misspecified Q-matrix. Under this circumstance, it’s urgently needed to find more objective Q-matrix inference methods. This paper started from this consideration, carried out further research on the Q-matrix inference from response data based on the research of Liu, Xu and Ying (2012), and modified the Liu et al. algorithm, designed a joint estimate item parameters and Q-matrix algorithm. The joint estimate algorithm can estimate item parameters and the Q-matrix simultaneously. In simulations, considered different Q-matrix (attribute-number is 3,4 and 5), different sample size (500, 1000, 2000 and 4000), different number of error items (3,4 and 5), the attribute mastery pattern of the sample followed an uniform distribution, and the item parameters followed an uniform distribution with interval [0.05,0.25]. When item parameters were unknown, item number was 20, and item attributes was 3, 4 or 5, based on the initial Q-matrix, and the joint estimate algorithm can get the true Q-matrix with a high probability and item parameters with small deviation, even the sample size is relatively small (such as 300), and the misspecified-item number is relatively large (such as 6). Furthermore, when the number of item attribute was misspecified by experts, in other words, the Q-matrix lacked a required attribute or added a redundant attribute, this would lead to incorrectness of all items, and the joint estimate algorithm will provide reliable information to infer the true Q-matrix. The results indicated that: (1) The joint estimate algorithm had a good performance and suitable for practical application when some item attribute vectors misspecified. (2) The joint estimate algorithm could provide useful information when added a redundant attribute or lacked a required attribute in Q-matrix, and then amended and estimated the Q-matrix.

Keywords cognitive diagnostic assessment      Q-matrix      T-matrix      joint estimate      DINA model     
Corresponding Authors: LUO Zhaosheng, E-mail: luozs@126.com   
Issue Date: 25 February 2015
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
YU Xiaofeng
LUO Zhaosheng
QIN Chunying
GAO Chunlei
LI Yujun
Cite this article:   
YU Xiaofeng,LUO Zhaosheng,QIN Chunying, et al. Joint Estimation of Model Parameters and Q-Matrix Based on Response Data[J]. Acta Psychologica Sinica, 10.3724/SP.J.1041.2015.00273
URL:  
http://journal.psych.ac.cn/xlxb/EN/10.3724/SP.J.1041.2015.00273     OR     http://journal.psych.ac.cn/xlxb/EN/Y2015/V47/I2/273
[1] PENG Yafeng; LUO Zhaosheng; YU Xiaofeng; GAO Chunlei; LI Yujun. The optimization of test design in Cognitive Diagnostic Assessment[J]. Acta Psychologica Sinica, 2016, 48(12): 1600-1611.
[2] CAI Yan; MIAO Ying; TU Dongbo. The polytomously scored cognitive diagnosis computerized adaptive testing[J]. Acta Psychologica Sinica, 2016, 48(10): 1338-1346.
[3] YU Xiaofeng; LUO Zhaosheng; GAO Chunlei; LI Yujun; WANG Rui; WANG Yutong. An Item Attribute Specification Method Based On the Likelihood D2 Statistic[J]. Acta Psychologica Sinica, 2015, 47(3): 417-426.
[4] LUO Zhaosheng; LI Yujun; YU Xiaofeng; GAO Chunlei; PENG Yafeng. A Simple Cognitive Diagnosis Method Based on Q-Matrix Theory[J]. Acta Psychologica Sinica, 2015, 47(2): 264-272.
[5] WANG Wenyi; DING Shuliang; SONG Lihong. Distance Discrimination Method based on Conditional Expectation in Cognitive Diagnosis[J]. Acta Psychologica Sinica, 2015, 47(12): 1499-1510.
[6] GUO Lei; ZHENG Chanjin; BIAN Yufang. Exposure Control Methods and Termination Rules in Variable-Length Cognitive Diagnostic Computerized Adaptive Testing[J]. Acta Psychologica Sinica, 2015, 47(1): 129-140.
[7] TU Dong-Bo,CAI Yan,DAI Hai-Qi. A New Method of Q-matrix Validation Based on DINA Model[J]. , 2012, 44(4): 558-568.
[8] TU Dong-Bo;CAI Yan;DAI Hai-Qi;DING Shu-Liang. A New Multiple-Strategies Cognitive Diagnosis Model: the MSCD Method[J]. Acta Psychologica Sinica, 2012, 44(11): 1547-1553.
[9] SUN Jia-Nan,ZHANG Shu-Mei,XIN Tao,BAO Yu. A Cognitive Diagnosis Method Based on Q-Matrix and Generalized Distance[J]. , 2011, 43(09): 1095-1102.
[10] TU Dong-Bo,CAI Yan,DAI Hai-Qi,DING Shu-Liang. A Polytomous Cognitive Diagnosis Model: P- DINA Model[J]. , 2010, 42(10): 1011-1020.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Acta Psychologica Sinica
Support by Beijing Magtech