A quantitative and model-driven approach to assessing higher education in the United States of America
Huang Z.; Qiu R.G.
2016
Quality in Higher Education
2
10.1080/13538322.2016.1147215
Abstract: University ranking or higher education assessment in general has been attracting more and more public attention over the years. However, the subjectivity-based evaluation index and indicator selections and weights that are widely adopted in most existing ranking systems have been called into question. In other words, the objectivity and impartiality of those rankings has been worrisome. To address these concerns, this paper presents a quantitative and model-driven approach to acquiring the evaluation index and indicator weights in the US News & World Report ranking system. Structural equation modelling will be applied to mine non-subjective weights from collected data. The proposed approach will be validated using two groups of United States universities, National Universities and Liberal Arts Colleges, classified by the US News & World Report. Managerial and administrative implications will also be explored. This study shows a very promising future because it opens a new venue for the scholars and practitioners in the higher education assessment field to develop a real-time, scalable and model-driven higher education ranking system. © 2016 Informa UK Limited, trading as Taylor & Francis Group.
Higher education; model-driven approach; ranking; ranking system; subjectivity
Anderson E.W., Fornell C., Foundations of the American customer satisfaction index, Total Quality Management, 11, 7, pp. 869-882, (2000); Aubert B.A., Rivard S., Patry M., Development of measures to assess dimensions of IS operation transactions, Omega, 24, 6, pp. 661-680, (1996); Becker J.M., Klein K., Wetzels M., Hierarchical latent variable models in PLS-SEM: guidelines for using reflective-formative type models, Long Range Planning, 45, 5-6, pp. 359-394, (2012); Bergseth B., Petocz P., Abrandt Dahlgren M., Ranking quality in higher education: guiding or misleading?, Quality in Higher Education, 20, 3, pp. 330-347, (2014); Bollen K., Structural Equations with Latent Variables, (1989); Bookstein F.L., Seidler H., Fieder M., Winckler G., Too much noise in the Times Higher Education rankings, Scientometrics, 85, 1, pp. 295-299, (2010); Chin W.W., The partial least squares approach to structural equation modeling, Modern Methods for Business Research, pp. 295-336, (1998); Chin W.W., Marcolin B.L., Newsted P.R., A partial least squares latent variable modeling approach for measuring interaction effects: results from a Monte Carlo simulation study and an electronic-mail emotion/adoption study, Information Systems Research, 14, 2, pp. 189-217, (2003); Compeau D.R., Higgins C.A., Application of social cognitive theory to training for computer skills, Information Systems Research, 6, 2, pp. 118-143, (1995); Esposito Vinzi V., Chin W.W., Henseler J., Wang H., Handbook of Partial Least Squares, (2010); European Customer Satisfaction Index-Foundation and Structure for Harmonized National Pilot Projects, (1998); Federkeil G., van Vught F.A., Westerheijden D.F., An evaluation and critique of current rankings, Multidimensional Ranking, pp. 39-70, (2012); Harvey L., Rankings of higher education institutions: a critical review, Quality in Higher Education, 14, 3, pp. 187-207, (2008); Hazelkorn E., Rankings and the Reshaping of Higher Education, (2011); Henseler J., Hubona G., Ringle C., Structural Equation Modeling Using SmartPLS, (2008); Kline R., Principles and Practice of Structural Equation Modeling, (2005); Liu N., Cheng Y., The academic ranking of world universities, Higher Education in Europe, 30, 2, pp. 127-136, (2005); Marginson S., van der Wende M., To rank or to be ranked: the impact of global rankings in higher education, Journal of Studies in International Education, 11, 3-4, pp. 306-329, (2007); Marks R.B., Sibley S.D., Arbaugh J.B., A structural equation model of predictors for effective online learning, Journal of Management Education, 29, 4, pp. 531-563, (2005); Marsh H.W., Yeung A.S., Causal effects of academic self-concept on academic achievement: structural equation models of longitudinal data, Journal of Educational Psychology, 89, 1, pp. 41-54, (1997); Pusser B., Marginson S., University rankings in critical perspective, The Journal of Higher Education, 84, 4, pp. 544-568, (2013); Qiu R.G., Computational thinking of service systems: dynamics and adaptiveness modeling, Service Science, 1, 1, pp. 42-55, (2009); Qiu R.G., A collaborative model of engineering education for complex global environments, paper presented at 2010 IEEE Frontiers in Education Conference, (2010); Qiu R.G., Service Science: The foundations of service engineering and management, (2014); Qiu R.G., Huang Z., Patel I.C., A big data approach to assessing the US higher education service, paper presented at the 12th International Conference on Service Systems and Service Management, (2015); Ringle C.M., Wende S., Will S., SmartPLS 2.0 (M3) Beta, (2005); Stolz I., Hendel D.D., Horn A.S., Ranking of rankings: benchmarking twenty-five higher education ranking systems in Europe, Higher Education, 60, 5, pp. 507-528, (2010); Stuart D.L., Reputational rankings: background and development, New Directions for Institutional Research, 1995, pp. 13-20, (1995); Times Higher Education World University Rankings, (2014); Umrank, U-multirank, (2015); Education, (2014); Van Vught F.A., Ziegele F., Design and Testing the Feasibility of a Multidimensional Global University Ranking, (2011); Van Vught F.A., Ziegele F., Multidimensional Ranking: The design and development of U-Multirank, (2012); Webster T.J., A principal component analysis of the U.S. News & World Report tier rankings of colleges and universities, Economics of Education Review, 20, 3, pp. 235-244, (2001)
Routledge
Article
Scopus