Abstract: In this study, we used Multivariate Generalizability Theory (MGT) to analyze the Putonghua Test conducted by the State Language Commission Random effect variance and covariance components were estimated in the G study Generalizability coefficients for each part of the test and composite generalizability coefficient for the whole test were estimated in the subsequent D study The results showed that the generalizability coefficient (reliability) is acceptable for the whole test but not for Part 3 (language use) of the test It is reasonable to combine the three part universe scores into a composite universe score in this test Since the generalizability coefficients of Part 1 and 2 in the test are large when employing three raters and 28 items for each part, therefore future test design can use fewer items

Key words: Multivariate Generalizability Theory, Putonghua Testing