The study focuses on the published 2006 rankings of The Times Higher Education Supplement "World University Rankings" and the Shanghai Jiao Tong University "Academic Ranking of World Universities". It found that only 133 institutions were shared between the top-200 lists of the Shanghai and Times rankings; four of the top-50 in the Shanghai list did not even appear among the first 500 universities of the Times ranking.
The study's authors argue that such discrepancies stem from poor methodology and inappropriate indicators, making the ranking systems invalid.
The Shanghai system, for example, measures research excellence in part by the number of Nobel- and Fields-winning alumni at the institution. However, few universities boast laureates on their staff, and their presence does not necessarily lead to better undergraduate education. Furthermore, the prize-winning staff usually have performed their ground-breaking work at another institution, so the measurement really addresses the ability of institutions to attract prestigious awardees rather than being the site where ground-breaking work is done.
The Times ranking, on the other hand, places great emphasis on the results of a survey sent out to more than 190,000 researchers. They are asked to list what they think are the top 30 universities in their field of research. Yet this survey is entirely opinion-based, and with a response rate below 1% may contain significant bias.
"There are flaws in the way that almost every indicator is used to compile these two popular rankings," says John Ioannidis, who led the analysis team. "I don't disagree that excellence is important to define, measure, interpret and improve, but the existing ranking criteria could actually harm science and education."
The study authors call for global collaboration to standardise data on key aspects of universities and other institutions, and any flaws should be openly admitted and not underestimated. "Evaluation exercises should not force spurious averages and oversimplified rankings for the many faces of excellence," says Ioannidis. "And efforts to improve institutions should not focus just on the numbers being watched."
Charlotte Webber | alfa
Smart Data Transformation – Surfing the Big Wave
02.12.2016 | Fraunhofer-Institut für Angewandte Informationstechnik FIT
Climate change could outpace EPA Lake Champlain protections
18.11.2016 | University of Vermont
In recent years, lasers with ultrashort pulses (USP) down to the femtosecond range have become established on an industrial scale. They could advance some applications with the much-lauded “cold ablation” – if that meant they would then achieve more throughput. A new generation of process engineering that will address this issue in particular will be discussed at the “4th UKP Workshop – Ultrafast Laser Technology” in April 2017.
Even back in the 1990s, scientists were comparing materials processing with nanosecond, picosecond and femtosesecond pulses. The result was surprising:...
Have you ever wondered how you see the world? Vision is about photons of light, which are packets of energy, interacting with the atoms or molecules in what...
A multi-institutional research collaboration has created a novel approach for fabricating three-dimensional micro-optics through the shape-defined formation of porous silicon (PSi), with broad impacts in integrated optoelectronics, imaging, and photovoltaics.
Working with colleagues at Stanford and The Dow Chemical Company, researchers at the University of Illinois at Urbana-Champaign fabricated 3-D birefringent...
In experiments with magnetic atoms conducted at extremely low temperatures, scientists have demonstrated a unique phase of matter: The atoms form a new type of quantum liquid or quantum droplet state. These so called quantum droplets may preserve their form in absence of external confinement because of quantum effects. The joint team of experimental physicists from Innsbruck and theoretical physicists from Hannover report on their findings in the journal Physical Review X.
“Our Quantum droplets are in the gas phase but they still drop like a rock,” explains experimental physicist Francesca Ferlaino when talking about the...
The Max Planck Institute for Physics (MPP) is opening up a new research field. A workshop from November 21 - 22, 2016 will mark the start of activities for an innovative axion experiment. Axions are still only purely hypothetical particles. Their detection could solve two fundamental problems in particle physics: What dark matter consists of and why it has not yet been possible to directly observe a CP violation for the strong interaction.
The “MADMAX” project is the MPP’s commitment to axion research. Axions are so far only a theoretical prediction and are difficult to detect: on the one hand,...
16.11.2016 | Event News
01.11.2016 | Event News
14.10.2016 | Event News
08.12.2016 | Life Sciences
08.12.2016 | Physics and Astronomy
08.12.2016 | Materials Sciences