ISSN 1671-3710
CN 11-4766/R
主办:中国科学院心理研究所
出版:科学出版社

心理科学进展 ›› 2024, Vol. 32 ›› Issue (6): 1010-1033.doi: 10.3724/SP.J.1042.2024.01010

• 研究方法 • 上一篇    

认知诊断评估中Q矩阵理论及应用

宋丽红1, 汪文义2(), 丁树良2   

  1. 1江西师范大学教育学院
    2江西师范大学计算机信息工程学院, 南昌 330022
  • 收稿日期:2023-08-18 出版日期:2024-06-15 发布日期:2024-04-07
  • 通讯作者: 汪文义, E-mail: wenyiwang@jxnu.edu.cn
  • 基金资助:
    国家自然科学基金(62267004);国家自然科学基金(62067005);国家自然科学基金(61967009);江西省普通本科高校教育教学改革研究课题(JXJG-23-2-6);江西省普通本科高校教育教学改革研究课题(JXJG-22-2-44)

Q-matrix theory and its applications in cognitive diagnostic assessment

SONG Lihong1, WANG Wenyi2(), DING Shuliang2   

  1. 1School of Education, Jiangxi Normal University, Nanchang 330022, China
    2School of Computer and Information Engineering, Jiangxi Normal University, Nanchang 330022, China
  • Received:2023-08-18 Online:2024-06-15 Published:2024-04-07

摘要:

Q矩阵是认知心理学与心理计量学结合的重要载体, Q矩阵在认知诊断中发挥着十分重要的作用。Q矩阵理论和应用研究近年来取得了重要进展。众多研究者从结构化到非结构化、属性二值到多值、简单到复杂模型、独立到一般结构、0-1到多级评分方面不断深入和拓展Q矩阵理论。Q矩阵理论也广泛应用于测验构念效度评价、计算机化自适应测验选题策略设计、Q矩阵学习和标定、认知诊断测验组卷等。与模型无关的Q矩阵理论和适合特定认知诊断模型下Q矩阵理论, 以及最新Q矩阵理论的应用都值得深入研究。

关键词: 认知诊断, Q矩阵, 属性结构, 完备性, 多值属性

Abstract:

The Q-matrix helps bridge the gap between cognitive psychology and psychometrics, and thus it plays a very important role in cognitive diagnostic assessment. Significant progress has been made in the Q-matrix theory and its applications in recent years. Numerous researchers have made significant contributions to the Q-matrix theory from structured to unstructured matrices, binary to polytomous attributes, simple to complex models, independent to general structures, and dichotomous to polytomous item responses.
The studies on the Q-matrix theory mainly contain four aspects of contents. The first is related research on the Q-matrix theory under ideal item response patterns. The representative study was the sufficient Q-matrix proposed by Tatsuoka (1995, 2009), which is used for representing the prerequisite relationships among the attributes and improving the construct validity of a test. Under the hierarchical relationships among the attributes, Ding et al. (2009) and their subsequent research found that a sufficient Q-matrix cannot completely distinguish the ideal item response patterns of different knowledge states. Therefore, they proposed a sufficient and necessary Q-matrix that must include a reachability matrix. Due to the rich information contained in polytomous scores, Ding et al. (2014) explored a method for constructing a complete Q-matrix under different attribute hierarchies for a certain polytomous scoring rule. As students’ cognitive levels at the same attribute may change over time in their learning progression, the polytomous sufficient Q-matrix was introduced and can be used to guide test design and item construction, and establish a one-to-one correspondence between knowledge states and ideal item response patterns (Ding et al., 2015; Sun et al., 2013).
The second is the study on complete Q-matrix theory under the nonparametric cognitive diagnostic framework. Under independent structure, Chiu (2009) proposed a complete Q-matrix containing an identity matrix, which can be used to distinguish different knowledge states from ideal item response patterns, and established the asymptotic classification theory of cluster analysis for cognitive diagnosis. Chiu and Köhn (2015) provided a general definition of a complete Q matrix based on expected item response patterns, and delved into the sufficient conditions for the Q matrix to be complete in general cognitive diagnostic models (such as the generalized deterministic inputs, noisy and gate model, the log-linear cognitive diagnosis model, the general diagnostic model) or simplified cognitive diagnostic models with two item parameters (such as the deterministic inputs, noisy and gate model, or the deterministic inputs, noisy or gate model, referred as the DINA or DINO model). The purpose of the design of the compete Q-matrix mainly focused on the identifiability of the knowledge state and derived the asymptotic classification theory under the general cognitive diagnostic model. At the same time, they also explored the completeness conditions of the structured and unstructured Q-matrices of the DINA model with attribute hierarchy structures.
The third kind of the complete Q-matrix was proposed for the general attribute structure under the framework of knowledge space theory. Heller (2022) summarizes and sorts out the relevant conclusions on complete Q-matrices under knowledge space theory. Unlike the independent structure and attribute hierarchy discussed earlier, the complete Q-matrix in conjunctive models under knowledge space theory is suitable for more general attribute structures. The fourth category is the complete Q-matrix under the framework of the model identifiability (Gu & Xu, 2021, 2023), which mainly includes the necessary and sufficient conditions for the strict identifiability of the DINA and DINO model parameters, the sufficient conditions for partial identifiability of cognitive diagnostic models with two-parameters or multi-parameters, and the model identifiability conditions for both item parameters and attribute hierarchy structures.
Following the introduction of the Q-matrix theory, four examples were presented to illustrate its applications in the theoretical validity criterion of diagnostic tests, the design of item selection methods in computerized adaptive test, the methods for Q-matrix learning and specification, and test construction for cognitive diagnosis. Model-free or model-based Q-matrix theory, and the applications of the latest Q-matrix theory needs to be further investigated.

Key words: cognitive diagnosis, Q-matrix, attribute structure, complete, polytomous attributes

中图分类号: