USING STRUCTURAL EQUATION MODELS TO ESTIMATE   RATER RELIABILITY IN GENERALIZABILITY THEORY

Abstract

Abstract: Due to the lack of tools and ways for estimating variance components in Generalizability Theory, the application of GT is limited. In this study, the principle of using Structural Equation Models to estimate variance components was introduced. This paper studied raters' consistency of structured interview in Council Servant Recruiting Test. 27 subjects of one unit were sampled in a certain province randomly. The crossed design(p×r×o) and unbalanced mixed design (p×(r:o))were analyzed. Estimation of variance components was conducted through EQS in two designs. This study illustrated that SEM is a powerful method for estimating rater reliability in GT.

Key words: Structural Equation Models, Generalizability Theory, rater reliability

Yan Fang, Li Weiming (Department of Psychology, East China Normal University, Shanghai 200062). (2002). USING STRUCTURAL EQUATION MODELS TO ESTIMATE RATER RELIABILITY IN GENERALIZABILITY THEORY. , 34(05), 92-97.

[1]	LUO Zhaosheng;GUO Xiaojun. The Optimal Size of Material in Psychological Experiment: The Applications of Multivariate Generalizability Theory [J]. Acta Psychologica Sinica, 2014, 46(6): 876-884.
[2]	ZHANG Minqiang; ZHANG Wenyi; LI Guangming; LIU Xiaoyu; Huang Feifei. Estimating Variance Components of Missing Data for Generalizability Theor [J]. Acta Psychologica Sinica, 2014, 46(12): 1897-1909.
[3]	LI Guangming;ZHANG Minqiang. Using Adjusted Bootstrap to Improve the Estimation of Variance Components and Their Variability for Generalizability Theory [J]. Acta Psychologica Sinica, 2013, 45(1): 114-124.
[4]	LI Guang-Ming,ZHANG Min-Qiang. Estimating the Variability of Estimated Variance Components for Generalizability Theory [J]. , 2009, 41(09): 889-901.
[5]	YU Zong-Huo,TANG Xiao-Juan,WANG Deng-Feng. A Comparison of GT and IRT: An Analysis of Performance Rating of Men’s 10 Me-ters Platform Diving in Beijing Olympic Games [J]. , 2009, 41(08): 773-784.
[6]	Yang Zhiming,Chang Lei,Ma Shiye. MULTIVARIATE GENERALIZABILITY ANALYSIS OF THE CHINESE COLLEGE ENTRANCE COMPREHENSIVE EXAMINATION [J]. , 2004, 36(02): 195-200.
[7]	Zhang-Aiqing,-Liu-Huashan. THE STRUCTURAL MODELS OF RESPONSIBILITY, AFFECT RESPONSE AND HELP GIVING FROM ATTRIBUTIONAL PERSPECTIVE [J]. , 2003, 35(04): 535-540.
[8]	Yang Zhiming,Chang Lei (Department of Educational Psychology, The Chinese University of Hong Kong). A STUDY ON PUTONGHUA TESTING BY MULTIVARIATE GENERALIZABILITY THEORY [J]. , 2002, 34(01): 51-56.
[9]	Li Weiming Yan Fang(Department of psychology, East-China Normal University, Shanghai 200062). MODEL SELECTIONS, VARIANCE COMPONENT EXPLANATIONS AND INDEXCOMPARISONS IN THE APPLICATION OF GENERALIZABILITYTHEORY:COMMENTS ON LIU AND ZHANG (1998,1999) [J]. , 2001, 33(05): 84-87.
[10]	Liu Yuanwo (Personnel Testing Authorities,Minisity of Personnel P.R.C.,Beijing 100054) Zhang Houcan (Beijing Normal University. Beijing 100875). APPLICATION OF GENERALIZABILITY THEORY IN COMPOSITION SCORING [J]. , 1998, 30(02): 211-218.

USING STRUCTURAL EQUATION MODELS TO ESTIMATE RATER RELIABILITY IN GENERALIZABILITY THEORY

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 10

Recommended Articles

Metrics

Comments