ISSN 0439-755X
CN 11-1911/B
主办：中国心理学会
　　　中国科学院心理研究所
出版：科学出版社

心理学报 ›› 2012, Vol. 44 ›› Issue (11): 1535-1546.doi: 10.3724/SP.J.1041.2012.01535

• 论文 • 上一篇    下一篇

教育认知诊断测验与认知模型一致性的评估

丁树良;毛萌萌;汪文义;罗芬;CUI Ying   

  1. (1江西师范大学计算机信息工程学院, 南昌 330022) (2南昌大学教育学院教育系, 南昌 330031) (3 Centre for Research in Applied Measurement and Evaluation (CRAME), University of Alberta, CA)
  • 收稿日期:2011-10-10 发布日期:2012-11-01 出版日期:2012-11-28
  • 通讯作者: 丁树良
  • 基金资助:

    国家自然科学基金(30860084, 31160203,31100756)、国家社会科学基金(12BYY055)、国家教育科学规划项目(CCA110109)、教育部人文社科项目(09JJCXLX012, 10YJCXLX049, 11YJC190002), 江西省教育厅科技计划项目(GJJ11385, GJJ10238)、全国教育考试科研规划课题(2009JKS2009)和高等学校博士学科点专项科研基金(20113604110001)资助。

Evaluating the Consistency of Test Items Relative to the Cognitive Model for Educational Cognitive Diagnosis

DING Shu-Liang;MAO Meng-Meng;WANG Wen-Yi;LUO Fen;CUI Ying   

  1. (1 School of Computer and Engineering, Jiangxi Normal University, Nanchang 330022, China) (2 College of Education, NanChang University, Nanchang 330031, China) (3 Centre for Research in Applied Measurement and Evaluation (CRAME), University of Alberta, CA)
  • Received:2011-10-10 Online:2012-11-01 Published:2012-11-28
  • Contact: DING Shu-Liang

PDF (PC)

2402

摘要： 构建正确的认知模型是成功进行认知诊断的关键之一, 如果认知诊断测验不能完整准确地代表这个认知模型, 这个测验的效度就存在问题。属性及其层级可以表示一个认知模型。在认知模型正确基础上, 给出了一个计量公式以衡量认知诊断测验能够多大程度上代表认知模型; 对于不止包含一个知识状态的等价类及其形成原因进行了分析, 对Cui等人的属性层级相合性指标(HCI)提出修改建议, 以更好地探查数据与专家给出的认知模型的一致性。

关键词: 认知诊断, 认知模型, 认知诊断测验

Abstract: Attributes and their hierarchy may present a cognitive model. Building a cognitive model is one of key steps for cognitive diagnosis as it is directly related to the validity and usefulness of test results. It is very important to detect whether the test specification coincides with the cognitive model before administering the test. In this paper, an explicit index is given to measure the extent to which the cognitive model is represented by the test items of the diagnostic test. We call this index as the theoretical construct validity (TCV). In terms of TCV, the test reported by Tatsuoka and her colleagues (1988) is reanalyzed, and the TCV of the test is only 9/24. That is, 24 knowledge states are obtained from the theoretic cognitive model but the test specification could distinguish only 9 knowledge states. Cui and her colleagues established a person fit index named hierarchy consistency index (HCI) to detect the fitness of an examinee’s observed response pattern (ORP) to an expected response pattern (ERP). HCI is not defined well when an examinee mastered one attribute only and there is only one item measuring the same attribute in the test, and the examinee responses correctly to the item. The original HCI could not compute for the number of comparisons being zero, hence the denominator being zero. In addition, the HCI includes the slipping only. Combining the slipping and guessing in the response to an item, we proposed a new index called modified HCI (MHCI). MHCI could detect the consistency of the response data and the cognitive model that is obtained by experts.

Key words: cognitive diagnosis, cognitive model, cognitive diagnostic test