Please wait a minute...
Acta Psychologica Sinica
|
An Item Attribute Specification Method Based On the Likelihood D2 Statistic
YU Xiaofeng1,2; LUO Zhaosheng1; GAO Chunlei1; LI Yujun1; WANG Rui1; WANG Yutong1
(1 School of Psychology, Jiangxi Normal University, Nanchang 330022, China) (2 Computer Department, Bozhou Normal College, Bozhou 236800, China)
Download: PDF(413 KB)  
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  

The Q-matrix is a very important component of cognitive diagnostic assessments, and it maps attributes to items. Cognitive diagnostic assessments infer the attribute mastery pattern of respondents based on item responses. In a cognitive diagnostic assessment, item responses are observable, whereas respondents’ attribute mastery pattern is potentially, but not immediately observable. The Q-matrix plays the role of a bridge in cognitive diagnostic assessments. Therefore, Q-matrix impacts the reliability and validity of cognitive diagnostic assessments greatly. Research on how the errors of Q-matrix affect parameter estimation and classification accuracy showed that the Q-matrix from experts’ definition or experience was easily affected by experts’ personal judgment, leading to a misspecified Q-matrix. Thus, it is important to find more objective Q-matrix inference methods. This paper was inspired by Liu, Xu and Ying’s (2012) algorithm and the item-data fit statistic G2 in the item response theory framework. Further research on the Q-matrix inference, an online Q-matrix estimation method based on the statistic D2 was proposed in the present study. Those items which are the base of the online algorithm are called as base items, and it is assumed that the base items are correctly pre-specified. The online estimation algorithm can jointly estimate item parameters and item attribute vectors in an incrementally manner. In the simulation studies, we considered the DINA model with different Q-matrix (attribute-number is 3, 4 and 5), different sample size (400, 500, 800 and 1000), and different number of correct items (8, 9, 10, 11 and 12) in the initial Q-matrix. The attribute mastery pattern of the sample followed a uniform distribution, and the item parameters followed a uniform distribution with interval [0.05, 0.25]. The results indicated that: when the number of base items was not too small, the online estimation algorithm with the D2 statistic could estimate the attribute vectors of rest items one by one, and further improve the estimation by using the joint estimation. When item parameters were unknown, item number was 20, and item attributes was 3, 4 or 5, based on the initial Q-matrix, the online estimation algorithm could recover the true Q-matrix with a high probability even when the number of base items were as small as 8.

Keywords item attribute specification      DINA model      likelihood ratio      online estimation     
Corresponding Authors: LUO Zhaosheng, E-mail: luozs@126.com   
Issue Date: 25 March 2015
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
YU Xiaofeng
LUO Zhaosheng
GAO Chunlei
LI Yujun
WANG Rui
WANG Yutong
Cite this article:   
YU Xiaofeng,LUO Zhaosheng,GAO Chunlei, et al. An Item Attribute Specification Method Based On the Likelihood D2 Statistic[J]. Acta Psychologica Sinica, 10.3724/SP.J.1041.2015.00417
URL:  
http://journal.psych.ac.cn/xlxb/EN/10.3724/SP.J.1041.2015.00417     OR     http://journal.psych.ac.cn/xlxb/EN/Y2015/V47/I3/417
[1] CAI Yan; MIAO Ying; TU Dongbo. The polytomously scored cognitive diagnosis computerized adaptive testing[J]. Acta Psychologica Sinica, 2016, 48(10): 1338-1346.
[2] YU Xiaofeng; LUO Zhaosheng; QIN Chunying; GAO Chunlei; LI Yujun. Joint Estimation of Model Parameters and Q-Matrix Based on Response Data[J]. Acta Psychologica Sinica, 2015, 47(2): 273-282.
[3] GUO Lei; ZHENG Chanjin; BIAN Yufang. Exposure Control Methods and Termination Rules in Variable-Length Cognitive Diagnostic Computerized Adaptive Testing[J]. Acta Psychologica Sinica, 2015, 47(1): 129-140.
[4] TU Dong-Bo,CAI Yan,DAI Hai-Qi. A New Method of Q-matrix Validation Based on DINA Model[J]. , 2012, 44(4): 558-568.
[5] TU Dong-Bo,CAI Yan,DAI Hai-Qi,DING Shu-Liang. A Polytomous Cognitive Diagnosis Model: P- DINA Model[J]. , 2010, 42(10): 1011-1020.
[6] Zhu Yu-Fang,Ding Shu-Liang. A Polytomous Extension of Attribute Hierarchy Method
Based on Graded Response Model
[J]. , 2009, 41(03): 267-275.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Acta Psychologica Sinica
Support by Beijing Magtech