Please wait a minute...
Acta Psychologica Sinica
|
Application of Rough Set Theory in Item Cognitive Attribute Identification
TANG Xiaojuan1; DING Shuliang2; YU Zonghuo3,4
 (1 School of Mathematics and Information Science, Nanchang Hangkong University, Nanchang 330063, China) (2 Computer Information Engineering College, Jiangxi Normal University, Nanchang 330022, China) (3 Jiangxi Key Laboratory for Psychology and Cognitive Science, Nanchang 330022, China) (4 School of Psychology, Jiangxi Normal University, Nanchang 330022, China)
Download: PDF(2895 KB)   Review File (1 KB) 
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  

Item Cognitive Attribute Identification (ICAI) is the basis of Cognitive Diagnosis (CD), which is designed to measure specific knowledge structures and processing skills in students. According to the published documents, there are two methods used in ICAI.The one is to indentify item attributes by some experts of relative domains. When there are many items, it will be a huge burgen for experts to identify their attributes in the items. Especially, for some items, it’s difficult for experts to get a unified opinion about items’ attributes. As an assistant to this one, the other method is to identify items’ attributes by CD-CAT (Cognitive Diagnostic Computerized Adaptive Testing). Using CD-CAT in ICAI is an obvious breakthrough, for that it is not necessary totally depentant on manual labour. But using CD-CAT in ICAI has some heavy limitation. For example, if the items’parameters such as difficulty, are unknown, big samples of subjects and items are necessary for CD-CAT to identify item attributes. The second limit of CD-CAT is that it is based on item pool, and the development of item pool is very expensive that the cost of one item is about $1000. Cognitive diagnosis is designed to provide information about students’ cognitive strengths and weaknesses and to assist the teaching. So, the best place to use it is in classrooms. But cognitive diagnosis is just used in lager–scale examinations now for two reasons: First, most cognitive diagnosis models are based on probability models which need a large sample in estimating item parameters, and the using of these cognitive diagnosis models are also based on a large sample of subjects even the items’ parameters have been estimated. Secondary, even though the method of CD-CAT can be used in a small–scale examination once the item parameters are known, CAT has been prohibited in many kinds of examinations for other reasons. So, it is very necessary to find a new method to indentify item attributes when item parameters are unknown, examinees are less and feedbacks are timely. In the current studies, we apply a new method – Rough Set Theory (RST) to ICAI. RST can solve the uncertainty in CD caused by the size of knowledge granularity. It doesn’t require any priori knowledge. Through the knowledge reduction, RST induces decision or classification rules, and then classifies the object. At first, we verificate the application of RST in ICAI. Then, in Study One, we explore how the match ratio of subjects' knowledge states and the slippage in subjects' responses to items impact the match ratio of item attributes. The number of item attributes is a variable which impacts the accuracy of CD, so, we also examine how the number of cognitive contributes impact the match ratio of item attributes. The results show that: (1) In the absence of item parameters, the rough set theory of ICAI has fast diagnostic speed and good results even though the sample size is small. So RST can be applied to classroom assessment. (2) The lower examinee’s PMR, the lower PMR of item attribute identification is. And the higher slippage in examinee’s response, the lower item attribute identification’s PMR is. (3) The more the number of item attributes, the lower item attribute identification’s PMR is. (4) Both results are estimated by rough set software, and regardless of sample size and item number, the estimated speed is very fast (about 10 seconds). It shows the advantage of RST in ICAI.

Keywords rough set theory      cognitive diagnosis      item attribute cognitive identification     
Corresponding Authors: DING Shuliang, E-mail: ding06026@163.com   
Issue Date: 25 July 2015
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
TANG Xiaojuan
DING Shuliang
YU Zonghuo
Cite this article:   
TANG Xiaojuan,DING Shuliang,YU Zonghuo. Application of Rough Set Theory in Item Cognitive Attribute Identification[J]. Acta Psychologica Sinica, 10.3724/SP.J.1041.2015.00950
URL:  
http://journal.psych.ac.cn/xlxb/EN/10.3724/SP.J.1041.2015.00950     OR     http://journal.psych.ac.cn/xlxb/EN/Y2015/V47/I7/950
[1] LIU Yanlou; XIN Tao; LI Lingqing; TIAN Wei; LIU Xiaoxiao. An improved method for differential item functioning detection in cognitive diagnosis models: An application of Wald statistic based on observed information matrix[J]. Acta Psychologica Sinica, 2016, 48(5): 588-598.
[2] ZHAN Peida; BIAN Yufang; WANG Lijun. Factors affecting the classification accuracy of reparametrized diagnostic classification models for expert-defined polytomous attributes[J]. Acta Psychologica Sinica, 2016, 48(3): 318-330.
[3] ZHAN Peida; CHEN Ping; BIAN Yufang. Using confirmatory compensatory multidimensional IRT models to do cognitive diagnosis[J]. Acta Psychologica Sinica, 2016, 48(10): 1347-1356.
[4] CAI Yan; MIAO Ying; TU Dongbo. The polytomously scored cognitive diagnosis computerized adaptive testing[J]. Acta Psychologica Sinica, 2016, 48(10): 1338-1346.
[5] KANG Chunhua; REN Ping; ZENG Pingfei. Nonparametric Cognitive Diagnosis: A Cluster Diagnostic Method  Based on Grade Response Items[J]. Acta Psychologica Sinica, 2015, 47(8): 1077-1088.
[6] ZHAN Peida; LI Xiaomin; WANG Wen-Chung; BIAN Yufang; WANG Lijun. The Multidimensional Testlet-Effect Cognitive Diagnostic Models[J]. Acta Psychologica Sinica, 2015, 47(5): 689-701.
[7] CAI Yan; TU Dongbo. Extension of Cognitive Diagnosis Models Based on the Polytomous Attributes Framework and Their Q-matrices Designs[J]. Acta Psychologica Sinica, 2015, 47(10): 1300-1308.
[8] WANG Zhuoran; GUO Lei; BIAN Yufang. Comparison of DIF Detecting Methods in Cognitive Diagnostic Test[J]. Acta Psychologica Sinica, 2014, 46(12): 1923-1932.
[9] TU Dongbo;CAI Yan;DAI Haiqi. Comparison and Selection of Five Noncompensatory Cognitive Diagnosis Models Based on Attribute Hierarchy Structure[J]. Acta Psychologica Sinica, 2013, 45(2): 243-252.
[10] CAI Yan;TU Dongbo;DING Shuliang. A Simulation Study to Compare Five Cognitive Diagnostic Models[J]. Acta Psychologica Sinica, 2013, 45(11): 1295-1304.
[11] TU Dong-Bo,CAI Yan,DAI Hai-Qi. A New Method of Q-matrix Validation Based on DINA Model[J]. , 2012, 44(4): 558-568.
[12] TU Dong-Bo;CAI Yan;DAI Hai-Qi;DING Shu-Liang. A New Multiple-Strategies Cognitive Diagnosis Model: the MSCD Method[J]. Acta Psychologica Sinica, 2012, 44(11): 1547-1553.
[13] DING Shu-Liang;MAO Meng-Meng;WANG Wen-Yi;LUO Fen;CUI Ying. Evaluating the Consistency of Test Items Relative to the Cognitive Model for Educational Cognitive Diagnosis[J]. Acta Psychologica Sinica, 2012, 44(11): 1535-1546.
[14] CHEN Ping,XIN Tao. Developing On-line Calibration Methods for Cognitive Diagnostic Computerized Adaptive Testing[J]. , 2011, 43(06): 710-724.
[15] YU Xiao-Feng,DING Shu-Liang,QIN Chun-Ying,LU Yun-Na. Application of Bayesian Networks to Identify Hierarchical Relation Among
Attributes in Cognitive Diagnosis
[J]. , 2011, 43(03): 338-346.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Acta Psychologica Sinica
Support by Beijing Magtech