Content uploaded by Domingo Docampo
Author content
All content in this area was uploaded by Domingo Docampo
Content may be subject to copyright.
A preview of the PDF is not available
Universidades españolas en la próxima edición ( 2012 ) del Shanghai Jiao Tong Academic Ranking of World Universities
Abstract
La aparición de clasificaciones de universidades realizadas con rigor constituye uno de los fenómenos más interesantes en el campo del análisis comparado de la educación superior. En particular, la creciente influencia del Shanghai academic ranking of world universities ha llevado a sus detractores a mostrar fuertes reticencias a su utilización como elemento de reflexión y fuente de mejora, debido fundamentalmente a que se pensaba que sus resultados no eran reproducibles. Una vez se ha encontrado la forma de replicar con altísima fiabilidad sus resultados, podemos no solamente evaluar los méritos de las instituciones que aparecen listadas, sino también los de aquellas que pueden estar a un paso de conseguir la clasificación. El presente trabajo realiza una estimación de las puntuaciones en la próxima edición del ranking de Shanghai, lo que nos permite reducir sensiblemente la incertidumbre acerca del conjunto de universidades españolas que estarán presentes en la lista oficial.
ResearchGate has not been able to resolve any citations for this publication.
I discuss the difficulties that I encountered in reproducing the results of the Shanghai ranking of world universities. In
the Shanghai ranking, the dependence between the score for the SCI indicator and the weighted number of considered articles
obeys a power law, instead of the proportional dependence that is suggested by the official methodology of the ranking. Discrepancies
from proportionality are also found in some of the scores for the N&S and Size indicators. This shows that the results of
the Shanghai ranking cannot be reproduced, given raw data and the public methodology of the ranking.
This paper discusses and copes with the difficulties that arise when trying to reproduce the results of the Shanghai ranking of world universities. Although the methodology of the ranking is a little ambiguous with regard to absolute (not relative to the best performer) scores on the six indicators that compose the ranking, the paper shows how to develop procedures to compute raw results and final relative scores. Discrepancies between estimated scores and the results of the Shanghai ranking are mostly associated with the difficulties encountered in the identification of institutional affiliations, and are not significant. We can safely state that the results of the Shanghai ranking are in fact reproducible.
In this article I introduce a new indicator that measures the presence of a higher education system in the Shanghai Jiao Tong Academic Ranking of World Universities (ARWU). First, the benefits of introducing such a measure and the drawbacks associated with the possible choices of the indicator are discussed. To analyze the drawbacks, the sample of countries with presence in ARWU is split into two groups of small and large world’s GDP share. A raw indicator based upon the sum of the scores of all the universities from a country divided by its world’s GDP share shows a noticeable bias in favor of small countries, so a one-way between-groups analysis of variance is conducted to help in canceling the bias. That leads to the introduction of a new aggregate indicator that can be computed in a very simple fashion. A discussion of the performance of higher education systems using this new indicator closes the paper.
We take a new look at the Shanghai Jiao Tong Academic Ranking of World Universities to evaluate the performance of whole university systems. We deal with system aggregates by means of averaging scores taken over a number of institutions from each higher education system according to the Gross Domestic Product of its country. We treat the set of indicators (measures) at the country level as a scale, and investigate its reliability and dimensionality using appropriate statistical tools. After a Principal Component Analysis is performed, a clear picture emerges: at the aggregate level ARWU seems to be a very reliable one-dimensional scale, with a first component that explains more than 72% of the variance of the sample under analysis. The percentages of variance of the indicators explained by the first component do shed light on the fact that ARWU is in fact measuring the research quality (both at the individual and collective levels) of a university system. When the second principal component is taken into account, the two principal components contribute to explain more than 90% of the variance. The rotated solution facilitates the interpretation of the components and provides clear and interesting clustering information about the 32 higher education systems under analysis.
The Institute of Higher Education, Shanghai Jiao Tong University has published on the web the Academic Ranking of World Universities that has attracted wide attentions worldwide. Institutions are ranked according to their academic or research performance. Ranking indicators include the alumni and staff winning major international awards, highly cited researchers in major research fields, articles published in selected top journals, articles indexed by major citation indexes, and performance per capita. Methodological problems discussed include quantitative versus qualitative evaluation, evaluation of research versus education, variety of institutions, language of publications, selection of awards, and studying or working experience of award winners. Technical problems such as definition of institutions, name expression of institutions, merging and splitting of institutions, searching and attribution of publications are discussed.
Rankings internacionales y calidad institucional
- D Docampo
Docampo, D. (2008). Rankings internacionales y calidad institucional. Revista de
Educación, Número Extraordinario, pp. 149-176.
World shares of publications of the USA, EU-27, and China compared and predicted using the new Web of Science interface versus Scopus. El profesional de la información
- L Leyersdoff
Leyersdoff, L. (2012) World shares of publications of the USA, EU-27, and China
compared and predicted using the new Web of Science interface versus Scopus. El
profesional de la información, v. 21, n. 1, pp. 43-49.
Estadística personal universitario
- Ministerio De Educación
Ministerio de Educación, Cultura y Deporte [17 de Febrero de 2012]. Estadística personal
universitario, PDI Curso 09-10. http://www.educacion.gob.es/educacion/universidades/
Estadisticas-informes/estadisticas/personal-universitario.html