1. Dr. Kazimierz Bilanow
Managing Director IREG Observatory on Academic Ranking and Excellence
Ankara, November 12, 2014
Academics Rankings - Spotlight on Quality
2. Ankara, November 12, 2014
New era in rankings?
The URAP ranking, U-Multirank, the new US News global ranking, Webometrics and some other rankings represent a dawn of new era in international academic ranking.
Era of comprehensive, quality focused multidimentional rankings.
Weakness of the „Big Three” rankings - they are limited to classifying only the first 500 institutions. Their methodology does not allow to responsibly asses and compare a larger group of institutions. This cannot be satisfying for many of some 18 000 Higher Education institutions in the world, especially those that may not be great as a whole but excel in in a particular field.
Opening question
3. Ankara, November 12, 2014
What has happend in the last 20 years
Parallel and overlapping processes:
massification of higher education and its internationalization.
It all happens in the era of globalization, the growth of the knowledge based economy and competition for best talent.
There are more and more universities, academic staff and students in the world but in reality, it’s only the best that count. The countries that do not understand that rule will lose in competition with their faster, smarter and more determined counterparts
4. Ankara, November 12, 2014
Massification - mass access to HEI
HE is no longer a privilege of the social elites. In a number of countries, over 40% of student age youth attend HE institutions.
5. Ankara, November 12, 2014
Internationalization
Students, academic teachers and researchers in large numbers move from country to country, from continent to continent.
6. Ankara, November 12, 2014
Globalization
In a knowledge based economy research and innovation determine position and competitive edge of the country and its economy.
7. Ankara, November 12, 2014
4,5 mln international students
175 mln students total
incl. 2,6% international students
Students of the World 2013
9. Ankara, November 12, 2014
IREG Observatory on Academic Ranking and Excellence
Association of ranking organizations and universities Its goal - improvement of the quality of international and national ranking of higher education institutions. system of discussion opened to international community and, evaluation of rankings organizing conferences and exchange of ‘good practice’ in academic ranking.
IREG Observatory
10. Ankara, November 12, 2014
First General Assembly Meeting, Warsaw 2010
IREG Observatory
11. Ankara, November 12, 2014
IREG Executive Committee
President: Jan Sadlak, f. Director, UNESCO-CEPES, Romania
Vice-Presidents: Liu Nian Cai, Center for World-Class Universities, Jiao Tong University, Shanghai, China
Waldemar Siwiński, Perspektywy Education Foundation, Warsaw, Poland
Gero Federkeil, CHE-Centre for Educational Development, Gütersloh, Germany
Members:
Paul Serban Agachi, Babes-Bolyai University, Cluj-Napoca, Romania
Dmitriy Grishankov, Expert Rating Agency, Moscow, Russia
Birte Hornemann, Aalborg University, Denmark
Sholpan Kalanova, Independent Kazakhstan Quality Assurance Agency in Education, Kazakhstan
Olesya Lynovytska, Scientific Research Institute of Applied Technologies, Kiev, Ukraine
Marko Marhl, University of Maribor, Slovenia
Robert J. Morse, U.S. News & World Report, Washington, DC, USA
Managing Director: Kazimierz Bilanow, Poland
www.ireg-observatory.org
IREG Observatory
12. Ankara, November 12, 2014
Berlin Principles on Ranking
Be clear about purpose and target groups
Provide clarity about sources
Specify contexts: linguistic, cultural, economic, and historical
Be transparent regarding methodology
Pay due attention to ethical standards and good practice
Use audited and verifiable data
Apply measures of quality assurance
IREG Activities
13. Ankara, November 12, 2014
IREG Ranking Audit
The purpose of the IREG Ranking Audit, conducted by independent academic teams, is:
to verify if a ranking under review is done professionally, observes good practices and provides students, their parents and employers with the
information allowing them to compare and assess programs offered
by higher education institutions.
IREG Activities
17. Ankara, November 12, 2014
Guidance for stakeholders
For the prospective students rankings serve as a tool in making informed choices concerning the institution and the field of study.
Researchers use rankings to compare their standing against their colleagues researches in other countries.
For university managers rankings are good tool to implement the culture of competiveness among the staff. It is also a good tool to monitor progress of implementation of reforms.
The employers expect that rankings will tell them at which universities to look for best future employees.
The politicians look to rankings to limit the risk in their investment decisions. And these decisions usually involve huge financial outlays.
IREG Activities
21. Ankara, November 12, 2014
Magnifying glass
a chance to be visible
in the rankings for a greater number of higher education institutions.
Ranking by Subject
22. Ankara, November 12, 2014
Reputation of a university is important.
But students are interested to get the best education in a specific field or subject.
Doctor’s, lawyer’s, engineer’s future professional career and income depend on on the quality of education in medicine, law or engineering.
Field of study in the center
Ranking by Subject
23. Ankara, November 12, 2014
Scientists want to know how their work is seen by their peers in the same field. They are interested to know how their institute or faculty compares to others; they want to know their place in the international competition. Their academic fame and money follow the reputation.
Fame and money follow the reputation
Ranking by Subject
24. Ankara, November 12, 2014
More and more ranking organization started to produce rankings focusing on the field of study or discipline.
The Shanghai Ranking, the THE, QS, URAP and others already started to rank universities not only as institutions but by standing in various fields or subjects.
Fields segments in global rankings
Ranking by Subject
25. Ankara, November 12, 2014
All respectfull national rankings do ranking by field of study:
US News & World Report „Best Colleges” (USA)
CHE University Ranking (Germany)
Perspektywy University Ranking (Poland)
National rankings – more advanced
Ranking by Subject
26. Ankara, November 12, 2014
Two ways to the same end
1. Methodology designed specifically to suit a given field. Example: CHE University Ranking (Germany), MBA ranking by the Financial Times.
2. Extracting the relevant data from the main university ranking. Examples: QS Ranking by Subject, Perspektywy University Ranking (Poland) by fields.
Ranking by Subject
28. Ankara, November 12, 2014
• Weighted salary (20)
• Salary increase (20)
• Value for money (3)
• Career progress (3)
• Aims achieved (3)
• Placement success (2)
• Employed at three months (2)
• Alumni recommend (2)
• Female faculty (2)
• Female students (2)
• Women board (1)
• International faculty (4)
• International students (4)
• International board (2)
• International mobility (6)
• International course experience (3)
• Languages (1)
• Faculty with doctorates (5)
• FT doctoral rank (5)
• FT research rank (10)
Specific approach
Ranking by Subject
30. Ankara, November 12, 2014
Conclusions
University rankings are necessary as they contribute to the proper functioning of the higher education systems in various countries. As an element of an independent evaluation, they are, along with accreditation and benchmarking, a basic tool assuring the high quality of teaching and research.
Rankings are perhaps imperfect, but very effective tool for comparing universities and quality assurance of higher education.
Rankings may irritate but they cannot be ignored. (Le Monde)
Final remarks
31. Ankara, November 12, 2014
New era of rankings?
We are witnessing a more divers approach to academic rankings and, indirectly, to the quality of higher education.
Quality of higher education must not be measured by citations or Nobel prizes alone. Even the Shanghai ranking realized it, and published recently its ranking calculated without the Nobel prizes.
International rankings are getting more sophisticated. Particularly important is the spreading of rankings by field or discipline.
Final remarks
32. Ankara, November 12, 2014
EUA: Impact not Illusion
Prestigious international academic organization, the European University Association only a few years ago had been skeptical, if not hostile to the very idea of university ranking.
The EUA report “Rankings in Institutional Strategies and Processes: Impact or Illusion?” released just last week, makes it quite clear that academic rankings have become a fact of life not to be ignored.
Final remarks
33. Dr. Kazimierz Bilanow
k.bilanow@ireg-observatory.org
www.ireg-observatory.org
Thank you