<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE root>
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ali="http://www.niso.org/schemas/ali/1.0/" article-type="other" dtd-version="1.2" xml:lang="en"><front><journal-meta><journal-id journal-id-type="publisher-id">Digital Economy &amp; Innovations</journal-id><journal-title-group><journal-title xml:lang="en">Digital Economy &amp; Innovations</journal-title><trans-title-group xml:lang="ru"><trans-title>Цифровая экономика и инновации</trans-title></trans-title-group></journal-title-group><issn publication-format="print">3034-2074</issn><issn publication-format="electronic">3034-4204</issn><publisher><publisher-name xml:lang="en">Togliatti State University</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="publisher-id">353</article-id><article-id pub-id-type="doi">10.18323/2221-5689-2022-3-15-24</article-id><article-categories><subj-group subj-group-type="toc-heading" xml:lang="en"><subject>Articles</subject></subj-group><subj-group subj-group-type="toc-heading" xml:lang="ru"><subject>Статьи</subject></subj-group><subj-group subj-group-type="article-type"><subject></subject></subj-group></article-categories><title-group><article-title xml:lang="en">The use of metrics in evaluation of the higher education efficiency: feasibility and limitations</article-title><trans-title-group xml:lang="ru"><trans-title>Использование метрик в измерениях эффективности высшего образования: целесообразность и ограничения</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-0472-671X</contrib-id><name-alternatives><name xml:lang="en"><surname>Vlasova</surname><given-names>Natalia Yurievna</given-names></name><name xml:lang="ru"><surname>Власова</surname><given-names>Наталья Юрьевна</given-names></name></name-alternatives><address><country country="RU">Russian Federation</country></address><bio xml:lang="en"><p>Doctor of Sciences (Economics), Professor, professor of Chair “Government and Municipal Management”</p></bio><bio xml:lang="ru"><p>доктор экономических наук, профессор, профессор кафедры «Государственное и муниципальное управление»</p></bio><email>nat-vlasova@yandex.ru</email><xref ref-type="aff" rid="aff1"/></contrib><contrib contrib-type="author"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-0076-3369</contrib-id><name-alternatives><name xml:lang="en"><surname>Molokova</surname><given-names>Elena Leonidovna</given-names></name><name xml:lang="ru"><surname>Молокова</surname><given-names>Елена Леонидовна</given-names></name></name-alternatives><address><country country="RU">Russian Federation</country></address><bio xml:lang="en"><p>PhD (Economics), assistant professor of Chair “Government and Municipal Management”</p></bio><bio xml:lang="ru"><p>кандидат экономических наук, доцент кафедры «Государственное и муниципальное управление»</p></bio><email>elmo.sm@mail.ru</email><xref ref-type="aff" rid="aff1"/></contrib></contrib-group><aff-alternatives id="aff1"><aff><institution xml:lang="en">Ural State University of Economics, Yekaterinburg</institution></aff><aff><institution xml:lang="ru">Уральский государственный экономический университет, Екатеринбург</institution></aff></aff-alternatives><pub-date date-type="pub" iso-8601-date="2022-09-30" publication-format="electronic"><day>30</day><month>09</month><year>2022</year></pub-date><issue>3</issue><issue-title xml:lang="en"/><issue-title xml:lang="ru"/><fpage>15</fpage><lpage>24</lpage><history><date date-type="received" iso-8601-date="2022-09-30"><day>30</day><month>09</month><year>2022</year></date></history><permissions><ali:free_to_read xmlns:ali="http://www.niso.org/schemas/ali/1.0/"/></permissions><self-uri xlink:href="https://vektornaukieconomika.ru/jour/article/view/353">https://vektornaukieconomika.ru/jour/article/view/353</self-uri><abstract xml:lang="en"><p>The efficiency of educational system is one of the key areas of research due to its significant impact on the development of an individual and the society, on the one hand, and the amount of resources allocated to this sector, on the other. The research is aimed at the theoretical understanding and analyzing of the practical implementation of the metrics used to evaluate higher education efficiency, and identifying possible risks associated with this assessment. The importance of the research is explained by the theoretical need to define the essence, components, and parameters of the effectiveness of education. Its practical significance is characterized by the need to form methodology and evaluating techniques that can adequately assess the direct and indirect effects of education, its impact on the development of the society. The paper gives a brief overview and comparative analysis of methodological approaches to the analysis of the higher education efficiency, identifies evaluation criteria depending on the context, object, and the research area. The authors define the methods to evaluate efficiency, among which the use of metrics is gaining popularity; however, they currently have a few limitations that form the risk of distorting the behavior of actors in the field of higher education. The analysis of a wide range of ratings, monitoring tests and other studies that use metrics allowed identifying their features that evoke systemic problems. Among such problems, the most likely and dangerous are the formation of deviant behavior of actors in the system of the higher education, combined with disregard for the goals and means of achieving them, and the likelihood of falling into the institutional trap of metrics.</p></abstract><trans-abstract xml:lang="ru"><p>Эффективность образования является одним из важнейших направлений исследования вследствие его существенного влияния на развитие личности и общества в целом, а также в связи со значительными ресурсами, выкладываемыми в этот сектор. Целью исследования стало теоретическое осмысление и анализ практического применения метрик для оценки эффективности высшего образования, выявление возможных рисков, связанных с данной оценкой. Актуальность исследования обусловлена теоретической потребностью в определении сущности, составляющих и параметров эффективности образования. Практическая значимость заключается в необходимости формирования методик оценки эффективности, наиболее адекватно определяющих прямые и косвенные эффекты образования для личности, региона и государства. В работе дан краткий обзор и сравнительный анализ методологических подходов к анализу эффективности высшего образования, идентифицированы критерии оценок в зависимости от контекста, объекта и полигона исследований. Выделены методы оценки эффективности, в ряду которых набирающим популярность является использование метрик, имеющее в настоящее время ряд ограничений, формирующих риск искажения поведения акторов сферы высшего образования. Проведенный анализ широкого спектра рейтингов, мониторингов и других мероприятий, использующих метрики, позволил идентифицировать их особенности, провоцирующие системные проблемы. В ряду последних наиболее вероятными и опасными являются формирование отклоняющегося поведения акторов системы высшего образования, сопряженного с пренебрежением к целям и средствам их достижения, а также вероятность попадания в институциональную ловушку метрик.</p></trans-abstract><kwd-group xml:lang="en"><kwd>economics of education</kwd><kwd>efficiency of education</kwd><kwd>higher education</kwd><kwd>evaluation of the efficiency of education</kwd><kwd>institutional trap</kwd></kwd-group><kwd-group xml:lang="ru"><kwd>экономика образования</kwd><kwd>эффективность образования</kwd><kwd>высшее образование</kwd><kwd>оценка эффективности образования</kwd><kwd>институциональная ловушка</kwd></kwd-group><funding-group/></article-meta></front><body></body><back><ref-list><ref id="B1"><label>1.</label><citation-alternatives><mixed-citation xml:lang="en">Klyachko T.L., Semionova E.A. Contribution of education to the socio-economic development of the subjects of the Russian Federation. Economy of Regions, 2018, no. 3, pp. 791–805. DOI: 10.17059/2018-3-8.</mixed-citation><mixed-citation xml:lang="ru">Клячко Т.А., Семионова Е.А. Вклад образования в социально-экономическое развитие субъектов Российской Федерации // Экономика региона. 2018. № 3. С. 791–805. DOI: 10.17059/2018-3-8.</mixed-citation></citation-alternatives></ref><ref id="B2"><label>2.</label><citation-alternatives><mixed-citation xml:lang="en">Deme M., Mahmoud A.M.A. Effect of quantity and quality of education on per capita real-GDP growth: evidence from low- and middle-income African countries. Applied Economics, 2020, vol. 52, no. 57, pp. 6248–6264. DOI: 10.1080/00036846.2020.1789058.</mixed-citation><mixed-citation xml:lang="ru">Deme M., Mahmoud A.M.A. Effect of quantity and quality of education on per capita real-GDP growth: evidence from low- and middle-income African countries // Applied Economics. 2020. Vol. 52. № 57. P. 6248–6264. DOI: 10.1080/00036846.2020.1789058.</mixed-citation></citation-alternatives></ref><ref id="B3"><label>3.</label><citation-alternatives><mixed-citation xml:lang="en">Polcyn J. Human development level as a modifier of education efficiency. Management, 2018, vol. 22, no. 2, pp. 171–186. DOI: 10.2478/manment-2018-0030.</mixed-citation><mixed-citation xml:lang="ru">Polcyn J. Human development level as a modifier of education efficiency // Management. 2018. Vol. 22. № 2. P. 171–186. DOI: 10.2478/manment-2018-0030.</mixed-citation></citation-alternatives></ref><ref id="B4"><label>4.</label><citation-alternatives><mixed-citation xml:lang="en">Del Bosco B., Mazzucchelli A., Chierici R., Di Gregorio A. Innovative startup creation: the effect of local factors and demographic characteristics of entrepreneurs. International Entrepreneurship and Management Journal, 2021, vol. 17, no. 1, pp. 145–164. DOI: 10.1007/s11365-019-00618-0.</mixed-citation><mixed-citation xml:lang="ru">Del Bosco B., Mazzucchelli A., Chierici R., Di Gregorio A. Innovative startup creation: the effect of local factors and demographic characteristics of entrepreneurs // International Entrepreneurship and Management Journal. 2021. Vol. 17. № 1. P. 145–164. DOI: 10.1007/s11365-019-00618-0.</mixed-citation></citation-alternatives></ref><ref id="B5"><label>5.</label><citation-alternatives><mixed-citation xml:lang="en">Pritchett L., Filmer D. What education production functions really show: a positive theory of education expenditures. Economics of Education Review, 1999, vol. 18, no. 2, pp. 223–239. DOI: 10.1016/s0272-7757(98)00034-x.</mixed-citation><mixed-citation xml:lang="ru">Pritchett L., Filmer D. What education production functions really show: a positive theory of education expenditures // Economics of Education Review. 1999. Vol. 18. № 2. P. 223–239. DOI: 10.1016/s0272-7757(98)00034-x.</mixed-citation></citation-alternatives></ref><ref id="B6"><label>6.</label><citation-alternatives><mixed-citation xml:lang="en">Veiderpass A., McKelvey M. Evaluating the performance of higher education institutions in Europe: a nonparametric efficiency analysis of 944 institutions. Applied Economics, 2016, vol. 48, no. 16, pp. 1504–1514. DOI: 10.1080/00036846.2015.1102844.</mixed-citation><mixed-citation xml:lang="ru">Veiderpass A., McKelvey M. Evaluating the performance of higher education institutions in Europe: a nonparametric efficiency analysis of 944 institutions // Applied Economics. 2016. Vol. 48. № 16. P. 1504–1514. DOI: 10.1080/00036846.2015.1102844.</mixed-citation></citation-alternatives></ref><ref id="B7"><label>7.</label><citation-alternatives><mixed-citation xml:lang="en">Thieme C., Giménez V., Prior D. A comparative analysis of the efficiency of national education systems. Asia Pacific Education Review, 2012, vol. 13, no. 1, pp. 1–15. DOI: 10.1007/s12564-011-9177-6.</mixed-citation><mixed-citation xml:lang="ru">Thieme C., Giménez V., Prior D. A comparative analysis of the efficiency of national education systems // Asia Pacific Education Review. 2012. Vol. 13. № 1. P. 1–15. DOI: 10.1007/s12564-011-9177-6.</mixed-citation></citation-alternatives></ref><ref id="B8"><label>8.</label><citation-alternatives><mixed-citation xml:lang="en">Agasisti T. The efficiency of public spending on education: An empirical comparison of EU countries. European Journal of Education, 2014, vol. 49, no. 4, pp. 543–557. DOI: 10.1111/ejed.12069.</mixed-citation><mixed-citation xml:lang="ru">Agasisti T. The efficiency of public spending on education: An empirical comparison of EU countries // European Journal of Education. 2014. Vol. 49. № 4. P. 543–557. DOI: 10.1111/ejed.12069.</mixed-citation></citation-alternatives></ref><ref id="B9"><label>9.</label><citation-alternatives><mixed-citation xml:lang="en">Karlik A.E., Krechko S.A., Platonov V.V. Development of metrics for personnel benchmarking in order to improve the personnel management system in the direction of innovative development. Russian Journal of Labor Economics, 2018, vol. 5, no. 2, pp. 373–394. DOI: 10.18334/et.5.2.39201.</mixed-citation><mixed-citation xml:lang="ru">Карлик А.Е., Кречко С.А., Платонов В.В. Разработка метрик для бенчмаркинга персонала с целью совершенствования системы управления персоналом в направлении инновационного развития // Экономика труда. 2018. Т. 5. № 2. С. 373–394. DOI: 10.18334/et.5.2.39201.</mixed-citation></citation-alternatives></ref><ref id="B10"><label>10.</label><citation-alternatives><mixed-citation xml:lang="en">Tesler G.S. Metrics and norms in the hierarchy of categorical semantics and functions. Matematicheskie mashiny i sistemy, 2005, no. 2, pp. 63–75. EDN: QYNTHZ.</mixed-citation><mixed-citation xml:lang="ru">Теслер Г.С. Метрики и нормы в иерархии категориальных семантик и функций // Математические машины и системы. 2005. № 2. С. 63–75. EDN: QYNTHZ.</mixed-citation></citation-alternatives></ref><ref id="B11"><label>11.</label><citation-alternatives><mixed-citation xml:lang="en">Shiryaev I.M., Fursa E.V., Mokrousova D.I., Maskaev A.I. Metrics for measuring the effectiveness of educational and scientific organizations: problems and prospects of application. Journal of economic regulation, 2018, vol. 9, no. 4, pp. 178–191. DOI: 10.17835/2078-5429.2018.9.4.178-191.</mixed-citation><mixed-citation xml:lang="ru">Ширяев И.М., Фурса Е.В., Мокроусова Д.И., Маскаев А.И. Метрики для измерения эффективности образовательных и научных организаций: проблемы и перспективы применения // Journal of economic regulation. 2018. Т. 9. № 4. С. 178–191. DOI: 10.17835/2078-5429.2018.9.4.178-191.</mixed-citation></citation-alternatives></ref><ref id="B12"><label>12.</label><citation-alternatives><mixed-citation xml:lang="en">Volchik V.V. The rise of metrics. Terra Economicus, 2018, vol. 16, no. 4, pp. 6–16. DOI: 10.23683/2073-6606-2018-16-4-6-16.</mixed-citation><mixed-citation xml:lang="ru">Вольчик В.В. Восхождение метрик // Terra Economicus. 2018. Т. 16. № 4. С. 6–16. DOI: 10.23683/2073-6606-2018-16-4-6-16.</mixed-citation></citation-alternatives></ref><ref id="B13"><label>13.</label><citation-alternatives><mixed-citation xml:lang="en">Volchik V.V., Maslyukova E.V. The metrics trip, or why is implicit knowledge underestimated when regulation of science and education is handled. Journal of institutional studies, 2018, vol. 10, no. 3, pp. 158–179. DOI: 10.17835/2076-6297.2018.10.3.158-179.</mixed-citation><mixed-citation xml:lang="ru">Вольчик В.В., Маслюкова Е.В. Ловушка метрик или почему недооценивается неявное знание в процессе регулирования сферы образования и науки // Журнал институциональных исследований. 2018. Т. 10. № 3. С. 158–179. DOI: 10.17835/2076-6297.2018.10.3.158-179.</mixed-citation></citation-alternatives></ref><ref id="B14"><label>14.</label><citation-alternatives><mixed-citation xml:lang="en">Arbo P., Benneworth P. Understanding the regional contribution of higher education institutions: A literature review. Paris, OECD Publishing, 2007. 78 р. (OECD Education Working Papers, № 9). DOI: 10.1787/19939019.</mixed-citation><mixed-citation xml:lang="ru">Arbo P., Benneworth P. Understanding the regional contribution of higher education institutions: A literature review. Paris: OECD Publishing, 2007. 78 р. (OECD Education Working Papers, № 9). DOI: 10.1787/19939019.</mixed-citation></citation-alternatives></ref><ref id="B15"><label>15.</label><citation-alternatives><mixed-citation xml:lang="en">Klofsten M., Fayolle A., Guerrero M., Mian S., Urbano D., Wright M. The entrepreneurial university as driver for economic growth and social change – Key strategic challenges. Technological Forecasting and Social Change, 2019, vol. 141, pp. 149–158. DOI: 10.1016/j.techfore.2018.12.004.</mixed-citation><mixed-citation xml:lang="ru">Klofsten M., Fayolle A., Guerrero M., Mian S., Urbano D., Wright M. The entrepreneurial university as driver for economic growth and social change – Key strategic challenges // Technological Forecasting and Social Change. 2019. Vol. 141. P. 149–158. DOI: 10.1016/j.techfore.2018.12.004.</mixed-citation></citation-alternatives></ref><ref id="B16"><label>16.</label><citation-alternatives><mixed-citation xml:lang="en">Kioupi V., Voulvoulis N. Sustainable development goals (SDGs): Assessing the contribution of higher education programmes. Sustainability, 2020, vol. 12, no. 17, p. 6701. DOI: 10.3390/su12176701.</mixed-citation><mixed-citation xml:lang="ru">Kioupi V., Voulvoulis N. Sustainable development goals (SDGs): Assessing the contribution of higher education programmes // Sustainability. 2020. Vol. 12. № 17. P. 6701. DOI: 10.3390/su12176701.</mixed-citation></citation-alternatives></ref><ref id="B17"><label>17.</label><citation-alternatives><mixed-citation xml:lang="en">Bazavlutskaya L.M., Evplova E.V., Konyaeva E.A. The goals of sustainable development in the field of education: features and challenges of implementation. Russian Journal of Education and Psychology, 2018, vol. 9, no. 6-1, pp. 19–35. DOI: 10.12731/2218-7405-2018-6-19-35.</mixed-citation><mixed-citation xml:lang="ru">Базавлуцкая Л.М., Евплова Е.В., Коняева Е.А. Цели устойчивого развития в области образования: особенности и проблемы реализации // Russian Journal of Education and Psychology. 2018. Т. 9. № 6-1. С. 19–35. DOI: 10.12731/2218-7405-2018-6-19-35.</mixed-citation></citation-alternatives></ref><ref id="B18"><label>18.</label><citation-alternatives><mixed-citation xml:lang="en">Ellson T. Assessing contribution of research in business to practice. Journal of Business Research, 2009, vol. 62, no. 11, pp. 1160–1164. DOI: 10.1016/j.jbusres.2008.10.008.</mixed-citation><mixed-citation xml:lang="ru">Ellson T. Assessing contribution of research in business to practice // Journal of Business Research. 2009. Vol. 62. № 11. P. 1160–1164. DOI: 10.1016/j.jbusres.2008.10.008.</mixed-citation></citation-alternatives></ref><ref id="B19"><label>19.</label><citation-alternatives><mixed-citation xml:lang="en">Širá E., Vavrek R., Vozárová I., Kotulič R. Knowledge economy indicators and their impact on the sustainable competitiveness of the EU countries. Sustainability, 2020, vol. 12, no. 10, pp. 4172. DOI: 10.3390/su12104172.</mixed-citation><mixed-citation xml:lang="ru">Širá E., Vavrek R., Vozárová I., Kotulič R. Knowledge economy indicators and their impact on the sustainable competitiveness of the EU countries // Sustainability. 2020. Vol. 12. № 10. P. 4172. DOI: 10.3390/su12104172.</mixed-citation></citation-alternatives></ref><ref id="B20"><label>20.</label><citation-alternatives><mixed-citation xml:lang="en">Griliches Z. Issues in Assessing the Contribution of Research and Development to Productivity Growth. The Bell Journal of Economics, 1979, vol. 10, no. 1, pp. 92–116. DOI: 10.2307/3003321.</mixed-citation><mixed-citation xml:lang="ru">Griliches Z. Issues in Assessing the Contribution of Research and Development to Productivity Growth // The Bell Journal of Economics. 1979. Vol. 10. № 1. P. 92–116. DOI: 10.2307/3003321.</mixed-citation></citation-alternatives></ref><ref id="B21"><label>21.</label><citation-alternatives><mixed-citation xml:lang="en">Backman M. Human capital in firms and regions: Impact on firm productivity. Papers in regional science, 2014, vol. 93, no. 3, pp. 557–575. DOI: 10.1111/pirs.12005.</mixed-citation><mixed-citation xml:lang="ru">Backman M. Human capital in firms and regions: Impact on firm productivity // Papers in regional science. 2014. Vol. 93. № 3. P. 557–575. DOI: 10.1111/pirs.12005.</mixed-citation></citation-alternatives></ref><ref id="B22"><label>22.</label><citation-alternatives><mixed-citation xml:lang="en">Polanyi M. Lichnostnoe znanie [Personal knowledge]. Moscow, Progress Publ., 1985. 344 p.</mixed-citation><mixed-citation xml:lang="ru">Полани М. Личностное знание: На пути к посткритической философии. М.: Прогресс, 1985. 344 с.</mixed-citation></citation-alternatives></ref><ref id="B23"><label>23.</label><citation-alternatives><mixed-citation xml:lang="en">Polterovich V.M. Institutional traps and ways out. Obshchestvennye nauki i sovremennost’, 2004, no. 3, pp. 5–16. EDN: OWOHPR.</mixed-citation><mixed-citation xml:lang="ru">Полтерович В.М. Институциональные ловушки: есть ли выход? // Общественные науки и современность. 2004. № 3. С. 5–16. EDN: OWOHPR.</mixed-citation></citation-alternatives></ref><ref id="B24"><label>24.</label><citation-alternatives><mixed-citation xml:lang="en">Merton R.K. Social structure and anomie. Sociology of power, 2010, no. 4, pp. 212–223. EDN: MQHTBT.</mixed-citation><mixed-citation xml:lang="ru">Мертон Р.К. Социальная структура и аномия // Социология власти. 2010. № 4. С. 212–223. EDN: MQHTBT.</mixed-citation></citation-alternatives></ref></ref-list></back></article>
