Please wait a minute...
Acta Psychologica Sinica    2012, Vol. 44 Issue (12) : 1687-1694     DOI: 10.3724/SP.J.1041.2012.01687
|
Estimating Homogeneity Coefficient and Its Confidence Interval
YE Baojuan;WEN Zhonglin
(1 School of Psychology, Jiangxi Normal University, Nanchang 330022, China) (2Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China)
Download: PDF(350 KB)  
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  Multidimensional tests are frequently applied to the studies of psychology, education, society and management. Before aggregating all item scores to form a composite score of a multidimensional test, we should consider the homogeneity of the test. Homogeneity coefficient which reflects the extent that all test items measure the same trait can be employed to evaluate test homogeneity. If homogeneity coefficient is low, the composite score is meaningless and cannot be used for further analyses. Homogeneity coefficient is the proportion of variability in composite score that is accounted for by the general factor, which is viewed as common to all items. Any multidimensional test can be represented by a bifactor model that contains a general factor and local factors. Hence homogeneity coefficient can be calculated based on a bifactor model. A unidimensional test with positively worded items and negatively worded items can also be represented by a bifactor model, where the assessed construct is the general factor and method factors are local factors. The confidence interval of homogeneity coefficient provides more information than its point estimate. There are three approaches to estimate the confidence interval of composite reliability: Bootstrap method, Delta method and direct use of the standard error generated from an SEM software output (e.g., LISREL). It has been found that the interval estimates that obtained by Delta method and Bootstrap method were almost the same, whereas the results obtained by LISREL software and by Bootstrap method had large differences. Delta method was recommended when estimating the confidence interval of composite reliability. In order to compute the confidence interval of homogeneity coefficient, we deduced a formula by using Delta method for computing the standard error of homogeneity coefficient. Based on the standard error, the confidence interval can be obtained easily. We used an example to illustrate how to calculate homogeneity coefficient and its confidence interval by using the proposed Delta method with LISREL software. We also illustrated how to get the same result with Mplus software that automatically calculates the standard error with Delta method and presents the confidence interval. Before composite scores of a test are aggregated for further statistical analysis, it is recommended to report homogeneity coefficient so that readers could evaluate the extent that the statistical results are reliable.
Keywords homogeneity coefficient      Delta method      confidence interval     
Corresponding Authors: WEN Zhonglin   
Issue Date: 25 December 2012
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
Cite this article:   
YE Baojuan;WEN Zhonglin. Estimating Homogeneity Coefficient and Its Confidence Interval[J]. Acta Psychologica Sinica,2012, 44(12): 1687-1694.
URL:  
http://journal.psych.ac.cn/xlxb/EN/10.3724/SP.J.1041.2012.01687     OR     http://journal.psych.ac.cn/xlxb/EN/Y2012/V44/I12/1687
[1] YE Bao-Juan,WEN Zhong-Lin. A Comparison of Three Confidence Intervals of Composite Reliability of A Unidimensional Test[J]. , 2011, 43(04): 453-461.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
Copyright © Acta Psychologica Sinica
Support by Beijing Magtech