The use of metrics in evaluation of the higher education efficiency: feasibility and limitations


Cite item

Full Text

Abstract

The efficiency of educational system is one of the key areas of research due to its significant impact on the development of an individual and the society, on the one hand, and the amount of resources allocated to this sector, on the other. The research is aimed at the theoretical understanding and analyzing of the practical implementation of the metrics used to evaluate higher education efficiency, and identifying possible risks associated with this assessment. The importance of the research is explained by the theoretical need to define the essence, components, and parameters of the effectiveness of education. Its practical significance is characterized by the need to form methodology and evaluating techniques that can adequately assess the direct and indirect effects of education, its impact on the development of the society. The paper gives a brief overview and comparative analysis of methodological approaches to the analysis of the higher education efficiency, identifies evaluation criteria depending on the context, object, and the research area. The authors define the methods to evaluate efficiency, among which the use of metrics is gaining popularity; however, they currently have a few limitations that form the risk of distorting the behavior of actors in the field of higher education. The analysis of a wide range of ratings, monitoring tests and other studies that use metrics allowed identifying their features that evoke systemic problems. Among such problems, the most likely and dangerous are the formation of deviant behavior of actors in the system of the higher education, combined with disregard for the goals and means of achieving them, and the likelihood of falling into the institutional trap of metrics.

About the authors

Natalia Yurievna Vlasova

Ural State University of Economics, Yekaterinburg

Author for correspondence.
Email: nat-vlasova@yandex.ru
ORCID iD: 0000-0002-0472-671X

Doctor of Sciences (Economics), Professor, professor of Chair “Government and Municipal Management”

Russian Federation

Elena Leonidovna Molokova

Ural State University of Economics, Yekaterinburg

Email: elmo.sm@mail.ru
ORCID iD: 0000-0003-0076-3369

PhD (Economics), assistant professor of Chair “Government and Municipal Management”

Russian Federation

References

  1. Klyachko T.L., Semionova E.A. Contribution of education to the socio-economic development of the subjects of the Russian Federation. Economy of Regions, 2018, no. 3, pp. 791–805. doi: 10.17059/2018-3-8.
  2. Deme M., Mahmoud A.M.A. Effect of quantity and quality of education on per capita real-GDP growth: evidence from low- and middle-income African countries. Applied Economics, 2020, vol. 52, no. 57, pp. 6248–6264. doi: 10.1080/00036846.2020.1789058.
  3. Polcyn J. Human development level as a modifier of education efficiency. Management, 2018, vol. 22, no. 2, pp. 171–186. doi: 10.2478/manment-2018-0030.
  4. Del Bosco B., Mazzucchelli A., Chierici R., Di Gregorio A. Innovative startup creation: the effect of local factors and demographic characteristics of entrepreneurs. International Entrepreneurship and Management Journal, 2021, vol. 17, no. 1, pp. 145–164. doi: 10.1007/s11365-019-00618-0.
  5. Pritchett L., Filmer D. What education production functions really show: a positive theory of education expenditures. Economics of Education Review, 1999, vol. 18, no. 2, pp. 223–239. doi: 10.1016/s0272-7757(98)00034-x.
  6. Veiderpass A., McKelvey M. Evaluating the performance of higher education institutions in Europe: a nonparametric efficiency analysis of 944 institutions. Applied Economics, 2016, vol. 48, no. 16, pp. 1504–1514. doi: 10.1080/00036846.2015.1102844.
  7. Thieme C., Giménez V., Prior D. A comparative analysis of the efficiency of national education systems. Asia Pacific Education Review, 2012, vol. 13, no. 1, pp. 1–15. doi: 10.1007/s12564-011-9177-6.
  8. Agasisti T. The efficiency of public spending on education: An empirical comparison of EU countries. European Journal of Education, 2014, vol. 49, no. 4, pp. 543–557. doi: 10.1111/ejed.12069.
  9. Karlik A.E., Krechko S.A., Platonov V.V. Development of metrics for personnel benchmarking in order to improve the personnel management system in the direction of innovative development. Russian Journal of Labor Economics, 2018, vol. 5, no. 2, pp. 373–394. doi: 10.18334/et.5.2.39201.
  10. Tesler G.S. Metrics and norms in the hierarchy of categorical semantics and functions. Matematicheskie mashiny i sistemy, 2005, no. 2, pp. 63–75. EDN: QYNTHZ.
  11. Shiryaev I.M., Fursa E.V., Mokrousova D.I., Maskaev A.I. Metrics for measuring the effectiveness of educational and scientific organizations: problems and prospects of application. Journal of economic regulation, 2018, vol. 9, no. 4, pp. 178–191. doi: 10.17835/2078-5429.2018.9.4.178-191.
  12. Volchik V.V. The rise of metrics. Terra Economicus, 2018, vol. 16, no. 4, pp. 6–16. doi: 10.23683/2073-6606-2018-16-4-6-16.
  13. Volchik V.V., Maslyukova E.V. The metrics trip, or why is implicit knowledge underestimated when regulation of science and education is handled. Journal of institutional studies, 2018, vol. 10, no. 3, pp. 158–179. doi: 10.17835/2076-6297.2018.10.3.158-179.
  14. Arbo P., Benneworth P. Understanding the regional contribution of higher education institutions: A literature review. Paris, OECD Publishing, 2007. 78 р. (OECD Education Working Papers, № 9). doi: 10.1787/19939019.
  15. Klofsten M., Fayolle A., Guerrero M., Mian S., Urbano D., Wright M. The entrepreneurial university as driver for economic growth and social change – Key strategic challenges. Technological Forecasting and Social Change, 2019, vol. 141, pp. 149–158. doi: 10.1016/j.techfore.2018.12.004.
  16. Kioupi V., Voulvoulis N. Sustainable development goals (SDGs): Assessing the contribution of higher education programmes. Sustainability, 2020, vol. 12, no. 17, p. 6701. doi: 10.3390/su12176701.
  17. Bazavlutskaya L.M., Evplova E.V., Konyaeva E.A. The goals of sustainable development in the field of education: features and challenges of implementation. Russian Journal of Education and Psychology, 2018, vol. 9, no. 6-1, pp. 19–35. doi: 10.12731/2218-7405-2018-6-19-35.
  18. Ellson T. Assessing contribution of research in business to practice. Journal of Business Research, 2009, vol. 62, no. 11, pp. 1160–1164. doi: 10.1016/j.jbusres.2008.10.008.
  19. Širá E., Vavrek R., Vozárová I., Kotulič R. Knowledge economy indicators and their impact on the sustainable competitiveness of the EU countries. Sustainability, 2020, vol. 12, no. 10, pp. 4172. doi: 10.3390/su12104172.
  20. Griliches Z. Issues in Assessing the Contribution of Research and Development to Productivity Growth. The Bell Journal of Economics, 1979, vol. 10, no. 1, pp. 92–116. doi: 10.2307/3003321.
  21. Backman M. Human capital in firms and regions: Impact on firm productivity. Papers in regional science, 2014, vol. 93, no. 3, pp. 557–575. doi: 10.1111/pirs.12005.
  22. Polanyi M. Lichnostnoe znanie [Personal knowledge]. Moscow, Progress Publ., 1985. 344 p.
  23. Polterovich V.M. Institutional traps and ways out. Obshchestvennye nauki i sovremennost’, 2004, no. 3, pp. 5–16. EDN: OWOHPR.
  24. Merton R.K. Social structure and anomie. Sociology of power, 2010, no. 4, pp. 212–223. EDN: MQHTBT.

Supplementary files

Supplementary Files
Action
1. JATS XML

Copyright (c)



This website uses cookies

You consent to our cookies if you continue to use our website.

About Cookies