Please wait a minute...
心理学报  2018, Vol. 50 Issue (1): 130-140    DOI: 10.3724/SP.J.1041.2018.00130
  本期目录 | 过刊浏览 | 高级检索 |
 不同认知结构被试的测验设计模式
 彭亚风1;  罗照盛1;  李喻骏2;  高椿雷1
 (1江西师范大学心理学院, 南昌 330022) (2华南师范大学心理应用研究中心/心理学院, 广州 510631)
 Optimization of test design for examinees with different cognitive structures
 PENG Yafeng1; LUO Zhaosheng1; LI Yujun2; GAO Chunlei1
 (1 School of psychology, Jiangxi Normal University, Nanchang 330022, China) (2 Center for Studies of Psychological Application/School of Psychology, South China Normal University, Guangzhou 510631, China)
全文: PDF(2101 KB)   评审附件 (1 KB) 
输出: BibTeX | EndNote (RIS)       背景资料
文章导读  
摘要  正如不同的病症需要使用不同的医疗技术方法来诊断一样, 不同的认知结构也需要设计对应的测验模式来进行诊断, 从而保证测验具有高质量的诊断评估效果。但传统测验形式未考虑不同认知结构的针对性诊断测验需求, 导致“千人一卷”在测验效率上有所不足; 认知诊断计算机化自适应测验虽可针对不同认知结构的被试施测不同的项目, 然而支持自适应过程的题库却没有针对不同认知结构被试设计对应的项目, 导致题库使用效率较低。要解决上述问题的关键在于, 探索如何针对不同认知结构设计相对应的测验模式。本研究采用Monte Carlo模拟, 对六种属性层级关系下, 不同认知结构的测验设计模式进行探讨。实验结果表明(1)同一属性层级关系下, 不同认知结构的最佳测验设计模式不同; (2)依据不同认知结构的最佳测验设计模式构建的题库具有更高的使用效率。测验编制者可以根据实验结果针对不同认知结构优化对应的测验设计模式, 并用于指导题库建设。
服务
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章
彭亚风
罗照盛
李喻骏
高椿雷
关键词 认知结构 测验模式设计 题库建设    
Abstract: Doctors have to use different medical technologies to diagnose different kinds of illness effectively. Similarly, teachers have to use well designed tests to provide an accurate evaluation of students with different cognitive structures. To provide such an evaluation, we recommend to adopt the Cognitive Diagnostic Assessment (CDA). CDA could measure specific cognitive structures and processing skills of students so as to provide information about their cognitive strengths and weaknesses. In general, the typical design procedure of a CDA test is as follow: firstly, identify the target attributes and their hierarchical relationships; secondly, design a Q matrix (which characterizes the design of test construct and content); finally, construct test items. Within that designing framework, two forms of test are available: the traditional test and the computerized adaptive test (CAT). The former is a kind of test that has a fixed-structure for all participants with different cognitive structures, the latter is tailored to each participant’s cognitive structure. Researchers have not, however, considered the specific test design for different cognitive structures when using these two test forms. As a result, the traditional test requires more items to gain a precise evaluation of a group of participants with mixed cognitive structures, and a cognitive diagnosis computer adaptive test (CD-CAT) has low efficiency of the item bank usage due to the problems in assembling a particular item bank. The key to overcome these hurdles is to explore the appropriate design tailored for participants with different cognitive structures. As discussed above, a reasonable diagnosis test should be specific for the cognitive structure of target examinees so to perform classification precisely and efficiently. This is in line with CAT. In CAT, an ideal item bank serves as a cornerstone in achieving this purpose. In this regard, Reckase (2003, 2007 & 2010) came up with an approach named p-optimality in designing an optimal item bank. Inspired by the p-optimality and working according to the characteristics of CDA, we proposed a method to design the test for different cognitive structures. We conducted a Monte Carlo simulation study to explore the different test design modes for different cognitive structures under six attribute hierarchical structures (Linear, Convergent, Divergent, Unstructured, Independent and Mixture). The results show that: (1) the optimal test design modes for different cognitive structures are different under the same hierarchical structure in test length, initial exploration stage (Stage 0), accurately estimation stage (Stage 1); (2) the item bank for cognitive diagnosis computer adaptive test (CD-CAT) we built, according to the different cognitive structures’ optimal test design modes, has a superior performance on item pool usage than other commonly used item banks no matter whether the fixed-length test or the variable-length test is used. We provide suggestions for item bank assembling basing on results from these experiments.
Key words cognitive structure    test design    item bank design
收稿日期: 2017-01-22      出版日期: 2017-11-28
中图分类号:     
  B841  
基金资助: 国家自然科学基金(31660279)、江西省社会科学规划(16JY36)、江西省研究生创新专项基金(YC2015-B025)资助。
通讯作者: 罗照盛, E-mail: luozs@126.com    
引用本文:   
彭亚风, 罗照盛, 李喻骏, 高椿雷. (2018).  不同认知结构被试的测验设计模式. 心理学报, 50(1): 130-140.
PENG Yafeng, LUO Zhaosheng, LI Yujun, GAO Chunlei. (2018).  Optimization of test design for examinees with different cognitive structures. Acta Psychologica Sinica, 50(1), 130-140.
链接本文:  
http://journal.psych.ac.cn/xlxb/CN/10.3724/SP.J.1041.2018.00130      或      http://journal.psych.ac.cn/xlxb/CN/Y2018/V50/I1/130
[1] 杨群 张积家. 正字法深度对汉族、维吾尔族大学生汉字词命名的影响[J]. 心理学报, 0, (): 0-0.
[2] 郝叶芳 王争艳 董书阳 刘斯漫 武萌 卢珊. 儿童早期的母亲生活压力对其5岁行为问题的预测效应:链式中介分析[J]. 心理学报, 0, (): 0-0.
[3] 刘贵雄 王余娟 买合甫来提.坎吉 贾永萍 郭春彦. 联结再认中双语者第二语言记忆优势效应[J]. 心理学报, 0, (): 0-0.
[4] 侯楠 彭坚. 恩威并施、积极执行与工作绩效——探索中国情境下双元领导的有效性[J]. 心理学报, 0, (): 0-0.
[5] 宋潮 邢怡伦 王建平. 失独父母创伤后应激障碍的症状特征及预测因素[J]. 心理学报, 0, (): 0-0.
[6] 徐岚 陆凯丽 崔楠. 享受当下,还是留待未来?——时间观对跨期决策的影响[J]. 心理学报, 0, (): 0-0.
[7] 黎晓丹 丁道群 叶浩生. 身体姿势启动的内隐权力感对公平决策的影响[J]. 心理学报, 0, (): 0-0.
[8] 王晓田. 用行为经济学应对不确定性:拓展有效助推的范畴[J]. 心理学报, 0, (): 0-0.
[9] 孙莎莎 李小兵 李宝山 刘承宜 黄敏儿. 正念提升身心健康的机制:来自HRV自相似证据[J]. 心理学报, 0, (): 0-0.
[10] 张丹丹 蔺义芹 柳昀哲 罗跃嘉. 厌恶与恐惧面孔的记忆编码、保持、提取[J]. 心理学报, 0, (): 0-0.
[11] 李美佳 庄丹琪 彭华茂. 基于问题解决式的类比推理的老化:表面相似性和结构相似性的作用[J]. 心理学报, 0, (): 0-0.
[12] 王志丹 周爱保 张荣华 卜梦瑾 李玉雯 王海静 Rebecca Williamson. 中美儿童基于物体重量归纳推理的跨文化比较[J]. 心理学报, 0, (): 0-0.
[13] 孙雅晨 张汉其 李勇辉 薛贵 何清华. 一味坚持还是灵活变换:换牌频率的神经结构基础和认知机制[J]. 心理学报, 0, (): 0-0.
[14] 李卫君 刘梦 张政华 邓娜丽 邢钰珊. 口吃者加工汉语歧义短语的神经过程[J]. 心理学报, 0, (): 0-0.
[15] 胡路明 苏晶 魏柳青 张学民. 多目标追踪中基于运动信息的分组效应[J]. 心理学报, 0, (): 0-0.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
版权所有 © 《心理学报》编辑部
本系统由北京玛格泰克科技发展有限公司设计开发  技术支持:support@magtech.com.cn