UDC378.14.015.62

Etuev Kh.Kh.¹ (Innopolis, Russian Federation) – k.etuev@innopolis.ru; Shupayev A.V.¹ (Innopolis, Russian Federation) – a.shupaev@innopolis.ru; Sokolova S.K.¹ (Innopolis, Russian Federation) – s.sokolova@innopolis.ru; Dorofeeva E.P.¹ (Innopolis, Russian Federation) – e.dorofeeva@innopolis.ru

¹Innopolis University

Abstract. As part of the “Digital Departments” project, Innopolis University was tasked in 2022 with conducting a comprehensive assessment of the development of digital competencies among students enrolled in additional professional retraining programs implemented by universities participating in the Ministry of Education and Science of Russia’s “Priority 2030” program. Consequently, over the two years of the “Digital Departments” project, our organization gathered material that enabled scientific research. The aim of this article is to present the generalized results of the assessment of the formation of digital competencies among students within the framework of the “Digital Departments” project. Thus, this article presents an analysis of the results of the final assessments conducted for the programs implemented on the basis of “digital departments”. The research methodology is based on the use of analysis, comparison, and synthesis of data on the number of students mastering the professional retraining programs (PRP), the competencies being formed, their scopes, profiles, and the economic sectors of the PRP, etc. The primary data for the study were obtained from the assessment conducted on an automated competency assessment platform developed by Innopolis University. The conducted research has several features. Firstly, it generalizes the results of all PRP implementations within the “Digital Departments” project. Secondly, this research allows for detailing certain aspects of the “Digital Departments” project that are not presented in official information sources (the names and number of economic sectors in which the programs are implemented, scopes of competencies, the total number of competencies, the most and least demanded competencies, etc.). Thirdly, the study provides information on the results of mastering PRPs by students of various age groups. All these features determine the novelty of the research.

Keywords: assessment, evaluation, professional retraining, levels of formation, digital departments, digital competencies, scopes of competencies.

References:

1. Avdeeva S.M., Tarasova K.V. On the assessment of digital literacy: methodology, conceptual model and measurement tool. Education Issues, 2023, no. 2. (In Russian). DOI: 10.17323/1814-9545-2023-2-8-32
2. Avilkina, S.V.; Bakuleva, M.A.; Kleinosova, N.P. Development of a methodology for assessing the levels of digital competencies in training. Scientific and Technical Vedomosti SPbSPU. Economic Sciences, 2019, vol. 12, no 2, pp. 40-51. (In Russian). DOI: 10.18721/JE.12204
3. Andrianov I.A., Polyansky A.M., Rzheutskaya S.Y., Kharina M.V. Diagnostics of the results of mastering competencies in the information learning environment of IT students. Open Education, 2023, vol. 27, no. 4, pp. 17-28. (In Russian). DOI: 10.21686/1818-4243-2023-4-17-28
4. Arstangaleeva G.F., Tezina M.N., Slobodchikova S.M. Evaluation of the formation of digital competencies of pedagogical workers. Domestic and Foreign Pedagogy.  2022, vol. 1, no. 3(84), pp. 140-155. (In Russian). DOI: 10.24412/2224-0772-2022-84-140-155
5. Bulavina E.V. On the experience of preparing graduate works on the platform “1C:Enterprise” within the framework of the project “Digital departments”. Information technologies in education, 2023, no. 6, pp. 48-52. (In Russian). URL: https://www.elibrary.ru/pshqvh 
6. Grigoriev V.Y. Open model of independent assessment of competencies of the digital economy. Management Consulting, 2020, no. 9(141), pp. 54-61. (In Russian). DOI: 10.22394/1726-1139-2020-9-54-61
7. Dyadkin Y.A. Model of assessment of students’ competencies in the conditions of digitalization of education. Modern pedagogical education, 2021, no. 11, pp. 80-83. (In Russian). URL:https://www.elibrary.ru/sdquky 
8. Ermakov S.G., Kutsenko S.M., Gilvanov R.G. Actual issues of organizing the activities of the digital department in the conditions of digital transformation of higher education institution. Izvestiya St. Petersburg University of Railway Engineering, 2023, vol. 20, issue.  1, pp.  70-78.  (In Russian). DOI: 10.20295/1815-588X-2023-1-70-78
9. Ilyin I.V., Kuzaev A.F. Practice of formation of digital competencies in students of non-IT directions within the framework of the project “Digital Department”. Pedagogical Education in Russia, 2023, no. 6, pp. 190-198. (In Russian). URL: https://www.elibrary.ru/kcjlvz 
10. Ishkhanyan Y.V., Ishkhanyan M.V., Sokolova I.I. Development of metrics for training students of transport universities within the framework of the project “Digital departments”. Transport business of Russia, 2023, no. 6, pp. 168-170. (In Russian). URL: https://www.elibrary.ru/uzilro 
11. Karstina S.G. Development of tools for assessing digital competencies in students of engineering specialties. Kazan Pedagogical Journal, 2021, no. 5(148), pp. 112-119. (In Russian). DOI: 10.51379/kpj.2021.149.5.014
12. Klimova Yu.O. Analysis of the compliance of the competence level of IT graduates with the requirements of employers. Territorial development issues, 2021, vol. 9, no 1. (In Russian). DOI: 10.15838/tdi.2021.1.56.5
13. Larin, S.N.; Noakk, N.V. Identification of actual competencies of applicants for vacancies of specialists of IT-industry enterprises. Bulletin of Altai Academy of Economics and Law, 2023, no. 5-2, pp. 256-262. (In Russian). DOI: 10.17513/vaael.2834
14. Lezina T.A., Khorosheva T.A., Korosteleva A.V. Digital trace as a tool for competence assessment: the case of Gazprom Neft. PROneft. Professionally about oil, 2021, vol. 6, no 2, pp. 91-98. (In Russian). DOI: 10.51890/2587-7399-2021-6-2-91-98
15. Naseikina L.F. Methodology for assessing the competence of future IT-specialists. Bulletin of Orenburg State University, 2015, no. 1(176), pp. 60-65. (In Russian). URL: https://www.elibrary.ru/twqxyz 
16. Ogurtsova, I.V. Digital trace as a tool for assessing competencies. Proc. “Innovation Management in the conditions of digital transformation”. St. Petersburg, St. Petersburg Peter the Great Polytechnic University Publ., 2022, pp. 125-130. (In Russian). DOI: 10.18720/SPBPU/2/id22-65
17. Prokhorov, P.E. Statistical assessment of the development of digital skills of the employed population in the Russian Federation. Statistics and Economics, 2022, vol. 19, no. 3, pp. 25-38. (In Russian). DOI: 10.21686/2500-3925-2022-3-25-38
18. Aleksandrova N.A., Kabanova L.V., Kondratova Yu. et al. Implementation of the project “Digital Chairs” of the national program “Digital Economy of the Russian Federation” in SGU. Information Technologies in Education, 2022, no. 5, pp. 9-13. (In Russian). URL: https://www.elibrary.ru/tcjenp 
19. Rebko O.V., Vetkina N.S. Diagnostic toolkit for assessing digital competencies of employees. Information and Education: communication boundaries, 2022, no. 14(22), pp. 80-82. (In Russian). URL:https://www.elibrary.ru/ehloia 
20. Sysoeva L.A. Approaches to the formation of the model of indicators of digital competencies of pedagogical staff of universities. New information technologies in education and science, 2020, no. 3, pp. 100-105. (In Russian). DOI: 10.17853/2587-6910-2020-03-100-105
21. Toktarova V.I., Rebko O.V., Semenova D.A. Comparative analysis of models of digital competencies of teachers in the conditions of digital transformation of education. Science for Education Today, 2023, vol. 13, no. 5, pp. 79-104. (In Russian). DOI: 10.15293/2658-6762.2305.04
22. Khodyreva E.A. Assessment of digital competencies of future teachers in the context of ensuring the quality of pedagogical education. Scientific and methodological electronic journal “Concept”, 2023, no. 11, pp. 220-233. (In Russian). DOI: 10.24412/2304-120X-2023-11120
23. Sheveleva O.E. Development of a functional model of the system of intellectual identification of students’ digital competencies. XXI century: results of the past and problems of the present plus, 2021, vol. 10, no. 1(53), pp. 35-39. (In Russian). DOI: 10.46548/21vek-2021-1053-0006
24. Shevchik, A.A. Methods of complex assessment of competencies of the advertising companies’ personnel in the conditions of digital economy. Bulletin of the Belarusian State Economic University, 2021, no. 6(149), pp. 31-37. (In Russian).URL:  https://www.elibrary.ru/jscfly 
25. Shilova O.N., Ignatieva E.Y. Research of tools for assessing digital competencies of a teacher. Man and Education, 2022, no. 2(71), pp. 99-108. (In Russian). DOI: 10.54884/S181570410020700-5
26. Yashin E.E., Kirdyashova E.V. To the question of identifying the level of formation of digital competencies in students within the project “Digital departments”. Business. Education. Law, 2023, no. 4(65), pp. 356-361. (In Russian). DOI: 10.25683/VOLBI.2023.65.800
27. Bayrak Karsli M., Kucuk S., Kilic R. et al. Assessment of Digital Competencies of Teacher Educators with the DigCompEdu Framework.International Journal of Curriculum and Instructional Studies (IJOCIS). 2023. Vol. 13(1). P. 67-94. DOI: 10.31704/ijocis.2023.004
28. Combéfis S. Automated Code Assessment for Education: Review, Classification and Perspectives on Techniques and Tools. Software, 2022, vol. 1(1), pp. 3-30. DOI: 10.3390/software1010002
29. Krugel J. et al., “Automated Measurement of Competencies and Generation of Feedback in Object-Oriented Programming Courses,” 2020 IEEE Global Engineering Education Conference (EDUCON), Porto, Portugal Publ., 2020. pp. 329-338, DOI: 10.1109/EDUCON45650.2020.9125323
30. Khan F., Vuopala E. (Digital Competence Assessment Across Generations: A Finnish Sample Using the Digcomp Framework. International Journal of Digital Literacy and Digital Competence, 2019, vol.10(2), pp. 15-28. DOI: 10.4018/IJDLDC.2019040102
31. Kajba M., Maja R., Potocan V. “Conceptual Model for Quality Assessment of Digital Competencies in Higher Education Systems – A Case Study of The Research Process,” Business Logistics in Modern Management. Osijek, Josip Juraj Strossmayer University of Osijek Publ., 2022. vol. 22. P. 51-68.
32. Moreira-Choez J.S., Gomez Barzola K.E., Lamus ´de Rodríguez T.M. et al. Assessment of digital competencies in higher education faculty: a multimodal approach within the framework of artificial intelligence. Frontiers in education, 2024, vol. 9. iD 1425487. DOI: 10.3389/feduc.2024.14254
33. Perdomo B., Morales O.A. Design and validation of a questionnaire to assess digital skills for research. Journal of E-Learning and Knowledge Society, 2024, vol. 20(3), pp. 83-89. DOI: 10.20368/1971-8829/1136008
34. Saltos-Rivas R., Novoa-Hernández P., Serrano Rodríguez R. On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study. PLoS ONE.  2021. vol. 16(9). iD: e0257344. DOI: 10.1371/journal.pone.0257344
35. Soriano-Alcantara, J.M., Guillén-Gámez, F.D., Ruiz-Palmero J. Exploring Digital Competencies: Validation and Reliability of an Instrument for the Educational Community and for all Educational Stages. Tech Know Learn, 2024. DOI: 10.1007/s10758-024-09741-6
36. Stoll S.E.M, Bauer I., Hopfer K. et al. Diagnosing homo digitalis: towards a standardized assessment for digital tool competencies. Front. Psychol, 2024, vol. 14. iD. 1270437. DOI: 10.3389/fpsyg.2023.1270437
37. Yang T.C. Assessment of the digital competencies of university instructors through use of the machine learning method. SN Soc Sci, 2023, vol. 25. DOI: 10.1007/s43545-023-00617-7

For citation: Etuev Kh.Kh., Shupayev A.V., Sokolova S.K., Dorofeeva E.P. Assessment of digital competencies within the implementation of the federal project “Digital departments”. CITISE, 2024, no. 4, pp. 371-385.