Please wait a minute...
   2011, Vol. 43 Issue (03) : 338-346     DOI:
|
Application of Bayesian Networks to Identify Hierarchical Relation Among
Attributes in Cognitive Diagnosis
YU Xiao-Feng;DING Shu-Liang;QIN Chun-Ying;LU Yun-Na
(1 Computer Information Engineer College, Jiangxi Normal University, Nanchang 330027, China)
(2 Computer Department, Bozhou teachers College, Bozhou 233500, China) (3 Nanchang No.1 high school, Nanchang 330003, China)
Download: PDF(471 KB)  
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  It’s very significant to correctly identify the hierarchical relation among attributes correctly when constructing a diagnosis test. As we know, there are various methods to identify the hierarchical relation among attributes in different cognitive diagnosis models (CDMs). Rule Space Model (RSM) is a kind of great influence CDM which was developed by Tatsuoka and her associates. In RSM, the task of attribute identification is performed after the test items have already been developed. And then an incidence Q matrix can be determined which reflects hierarchical relation. However, in Leighton, Gierl and Hunka’s (2004) Attribute Hierarchy Method (AHM) the organization of attributes(attributes, number of attributes and attribute hierarchical relation) should be determined before developing the test items. In RSM and AHM the importance of correctly identifying the attributes and their hierarchical relation cannot be overstated, and the attributes and their hierarchical relations serve as the most important input variables to the models because they provide the basis for interpreting the results. The hierarchical relation among attributes describes the domain knowledge structures. Understanding the domain knowledge structures in highly specific detail provides a rational basis for proposing and evaluating potential improvements in the measurement of general proficiency. Otherwise, improvement remains largely a trial-and-error process. It has been proved that is not reliable to get the hierarchical relation by analyzing the test items, even the resulting hierarchical relations are not unique.
Now, structure learning of Bayesian Networks would be introduced to study the hierarchical relation from the examinees’ attribute mastery patterns. On the one hand, this paper conducted a simulation study in which Cui, Leighton and Zheng (2006)’s attribute hierarchical relation was employed, and the sample size of 5000 was used. In the simulated study, different sliping rates was considered for the purpose of testing the robustness of Bayesian structure learning. On the other hand, this paper conducted an empirical study to research the attributes which were commonly used in different numeration representation system converting, and the sample size was 189. Also the hierarchical relation generated by Bayesian structure learning and the hierarchical relation extracted by domain expert was compared.
The result of simulation study and empirical study all showed the Bayesian Networks was a very useful tool in determining the hierarchical relation among attributes in the realm of education measurement and psychometrics. It is proved that the result for reference is valuable through structure learning of Bayesian Networks in simulated experiments and practical application. Meanwhile, the Bayesian Networks also can be used to test the hierarchical relation in RSM.
Keywords rule space model      cognitive diagnosis      Bayesian networks      structure learning     
Corresponding Authors: DING Shu-Liang   
Issue Date: 30 March 2011
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
YU Xiao-Feng
DING Shu-Liang
QIN Chun-Ying
LU Yun-Na
Cite this article:   
YU Xiao-Feng,DING Shu-Liang,QIN Chun-Ying, et al. Application of Bayesian Networks to Identify Hierarchical Relation Among
Attributes in Cognitive Diagnosis
[J]. , 2011, 43(03): 338-346.
URL:  
http://journal.psych.ac.cn/xlxb/EN/      OR     http://journal.psych.ac.cn/xlxb/EN/Y2011/V43/I03/338
[1] LIU Yanlou; XIN Tao; LI Lingqing; TIAN Wei; LIU Xiaoxiao. An improved method for differential item functioning detection in cognitive diagnosis models: An application of Wald statistic based on observed information matrix[J]. Acta Psychologica Sinica, 2016, 48(5): 588-598.
[2] ZHAN Peida; BIAN Yufang; WANG Lijun. Factors affecting the classification accuracy of reparametrized diagnostic classification models for expert-defined polytomous attributes[J]. Acta Psychologica Sinica, 2016, 48(3): 318-330.
[3] ZHAN Peida; CHEN Ping; BIAN Yufang. Using confirmatory compensatory multidimensional IRT models to do cognitive diagnosis[J]. Acta Psychologica Sinica, 2016, 48(10): 1347-1356.
[4] CAI Yan; MIAO Ying; TU Dongbo. The polytomously scored cognitive diagnosis computerized adaptive testing[J]. Acta Psychologica Sinica, 2016, 48(10): 1338-1346.
[5] KANG Chunhua; REN Ping; ZENG Pingfei. Nonparametric Cognitive Diagnosis: A Cluster Diagnostic Method  Based on Grade Response Items[J]. Acta Psychologica Sinica, 2015, 47(8): 1077-1088.
[6] TANG Xiaojuan; DING Shuliang; YU Zonghuo. Application of Rough Set Theory in Item Cognitive Attribute Identification[J]. Acta Psychologica Sinica, 2015, 47(7): 950-962.
[7] ZHAN Peida; LI Xiaomin; WANG Wen-Chung; BIAN Yufang; WANG Lijun. The Multidimensional Testlet-Effect Cognitive Diagnostic Models[J]. Acta Psychologica Sinica, 2015, 47(5): 689-701.
[8] CAI Yan; TU Dongbo. Extension of Cognitive Diagnosis Models Based on the Polytomous Attributes Framework and Their Q-matrices Designs[J]. Acta Psychologica Sinica, 2015, 47(10): 1300-1308.
[9] WANG Zhuoran; GUO Lei; BIAN Yufang. Comparison of DIF Detecting Methods in Cognitive Diagnostic Test[J]. Acta Psychologica Sinica, 2014, 46(12): 1923-1932.
[10] TU Dongbo;CAI Yan;DAI Haiqi. Comparison and Selection of Five Noncompensatory Cognitive Diagnosis Models Based on Attribute Hierarchy Structure[J]. Acta Psychologica Sinica, 2013, 45(2): 243-252.
[11] CAI Yan;TU Dongbo;DING Shuliang. A Simulation Study to Compare Five Cognitive Diagnostic Models[J]. Acta Psychologica Sinica, 2013, 45(11): 1295-1304.
[12] TU Dong-Bo,CAI Yan,DAI Hai-Qi. A New Method of Q-matrix Validation Based on DINA Model[J]. , 2012, 44(4): 558-568.
[13] TU Dong-Bo;CAI Yan;DAI Hai-Qi;DING Shu-Liang. A New Multiple-Strategies Cognitive Diagnosis Model: the MSCD Method[J]. Acta Psychologica Sinica, 2012, 44(11): 1547-1553.
[14] DING Shu-Liang;MAO Meng-Meng;WANG Wen-Yi;LUO Fen;CUI Ying. Evaluating the Consistency of Test Items Relative to the Cognitive Model for Educational Cognitive Diagnosis[J]. Acta Psychologica Sinica, 2012, 44(11): 1535-1546.
[15] CHEN Ping,XIN Tao. Developing On-line Calibration Methods for Cognitive Diagnostic Computerized Adaptive Testing[J]. , 2011, 43(06): 710-724.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Acta Psychologica Sinica
Support by Beijing Magtech