ISSN 0439-755X
CN 11-1911/B
主办:中国心理学会
   中国科学院心理研究所
出版:科学出版社

心理学报 ›› 2022, Vol. 54 ›› Issue (11): 1403-1415.doi: 10.3724/SP.J.1041.2022.01403

• 研究报告 • 上一篇    下一篇

多级属性Q矩阵的验证与估计

秦春影1,2, 喻晓锋1()   

  1. 1江西师范大学心理学院, 南昌 330022
    2南昌师范学院数学与信息科学学院, 南昌 330032
  • 收稿日期:2021-10-06 发布日期:2022-09-08 出版日期:2022-11-25
  • 通讯作者: 喻晓锋 E-mail:xyu6@jxnu.edu.cn
  • 基金资助:
    全国教育科学规划项目(BGA210060);教育部教育考试院“十四五”规划支撑专项课题(NEEA2021050);江西省社会科学基金项目(21JY06);江西省高校人文社会科学项目(XL20202);南昌市教育大数据智能技术重点实验室(2020-NCZDSY-012);江西省教育厅科技项目(GJJ212602);江西省教育厅科技项目(GJJ191691);江西省教育厅科技项目(GJJ191128)

Validation and estimation of expert-defined Q-matrix with polytomous attribute

QIN Chunying1,2, YU Xiaofeng1()   

  1. 1School of Psychology, Jiangxi Normal University, Nanchang, 330022, China
    2School of Mathematics and Information Science, Nanchang Normal University, Nanchang 330032, China
  • Received:2021-10-06 Online:2022-09-08 Published:2022-11-25
  • Contact: YU Xiaofeng E-mail:xyu6@jxnu.edu.cn

摘要:

多级属性是将诊断测验中传统的二值(即两种水平, 通常定义为0和1)属性定义为多值(多个水平可以为0, 1, …), 它不但可以描述学生对于知识属性是否掌握, 而且可以描述学生在属性上的掌握程度, 这样使得诊断测验能提供给被试更丰富的知识掌握详情。本文将适用于二级属性Q矩阵的统计量(S统计量)拓展到多级属性下的Q矩阵验证和估计, 在两种常见的条件下, 设计了两种估计算法:联合估计算法和在线估计算法。模拟实验结果表明:联合估计算法适用于对专家界定的初始Q矩阵进行验证, 当初始Q矩阵中包含较少的错误时, 通过联合估计算法有很大可能恢复正确的Q矩阵; 在线估计算法适用于对“新项目”进行属性向量和项目参数的在线标定, 基于一定数量的“基础项目”, 在线估计算法对于新项目的估计也能达到较满意的成功率。实证数据分析则进一步展示了该方法的使用。

关键词: 多级属性, Q矩阵, p-DINA模型, S统计量

Abstract:

Cognitive diagnosis has recently gained prominence in educational assessment, psychiatric evaluation, and many other disciplines. Generally, entries in the Q-matrix of traditional cognitive diagnostic tests are binary (two levels, defined as 0 and 1). Polytomous attributes (multi-levels, defined as 0, 1, …), particularly those defined as part of the test development process, can provide additional diagnostic information. Compared to binary attributes, polytomous attributes can not only describe the student's knowledge profile, but can provide more extensive details.

As we all know, Q-matrix impacts the accuracy of cognitive diagnostic assessment greatly. Research on the effect of parameter estimation and classification accuracy caused by the error in Q-matrix already existed, and it turned out that Q-matrix gotten from expert definition or experience was more easily subject to be affected by subjective factors, lead to a misspecified Q-matrix. Under this circumstance, it’s urgently needed to find more objective polytomous-attribute Q-matrix verification and inference methods.

The present research proposes the verification and estimation of expert-defined polytomous attribute Q-matrix based on the polytomous deterministic inputs, noisy, ‘‘and’’ gate (p-DINA) model. We intend to extend the methods adapted to binary Q-matrix verification and estimation to polytomous attribute Q-matrix, and the proposed methods which can be used in different conditions are joint estimation and online estimation. Simulation results show that: the joint estimation algorithm can be applied to the Q-matrix validation which needs an initial Q-matrix defined by experts, the online estimation algorithm can be applied to online estimate the “new items” based on a certain number of “based items”. Under the various settings in the simulations, the two estimation algorithms can recover the correct polytomous-attribute Q-matrix at a high probability. Empirical study also indicates that the two proposed algorithms can be applied in Q-matrix validation or estimation for CDA with polytomous attributes.

Key words: polytomous attribute, Q-matrix, p-DINA model, S statistics

中图分类号: