Berman N.D.
OVERCOMING THE CHALLENGES OF IMPLEMENTING AI AGENTS IN EDUCATIONAL ENVIRONMENT: FOCUS ON ETHICAL ASPECTS AND RISKS
UDC 378.1
Berman N.D.1 (Khabarovsk, Russian Federation) – nina.berman@mail.ru
1Pacific National University
Abstract. The introduction of artificial intelligence into the educational environment opens up new prospects for personalizing learning and increasing its effectiveness, but is associated with a set of ethical, legal and pedagogical challenges. AI refers to the development of computing technologies designed to perform tasks that typically require human intelligence, such as learning, reasoning and problem solving. The integration of AI agents into education facilitates innovation aimed at solving key pedagogical problems, such as personalization, motivation and scalability. The aim of the study is to analyze the key ethical risks of implementing AI agents and propose mechanisms to minimize them. The objectives of the study include an overview of the use of AI tools, identifying the key benefits and potential threats, systematizing the ethical risks arising from the use of AI in education, identifying gaps in current regulation and pedagogical practice. AI agents are autonomous or semi-autonomous systems capable of processing data, making decisions and performing tasks, often without direct human intervention. The use of AI in education faces a number of controversies. One of the main contradictions can be called the conflict between personalization and privacy in educational AI systems. The problem of algorithmic bias, manifested in biased assessments and discriminatory recommendations, which can exacerbate social inequality, is considered. The phenomenon of dehumanization of education, expressed in the substitution of human interaction with standardized algorithmic decisions, is also analyzed. Another challenge and ethical risk of using AI agents in education is the problem of transparency and explainability, the so-called “black box” in AI decision-making and the lack of clear criteria for evaluating the performance of algorithms. The study discusses the issue of legal liability for AI decisions. The practical significance of the study lies in the development of a systematic approach to balancing technological innovations and humanitarian values. The research materials can be useful for developers of educational technologies, teachers involved in the digital transformation of education.
Keywords: artificial intelligence in education, AI agent, AI ethics, algorithmic bias, AI transparency and explainability, data protection, digital pedagogy, legal regulation of AI.
References:
- Kabudi T., Pappas I., Olsen D. H. AI-enabled adaptive learning systems: A systematic mapping of the literature. Computers and education: Artificial intelligence, 2021, vol. 2. 100017. DOI: 10.1016/j.caeai.2021.100017
- Luckin R., Cukurova M. Designing educational technologies in the age of AI: A learning sciences‐driven approach. British Journal of Educational Technology, 2019, vol. 5, no 6, pp. 2824-2838. DOI:10.1111/bjet.12861
- Arzhanova K.A., Dolgopolov D.V., Starostin V.S. Mechanism for adapting artificial intelligence tools to the field of higher education. Human capital, 2023, vol. 10 (178), pp. 41-51. (In Russian). URL: https://elibrary.ru/irmkny
- Korableva O.N., Smirnova A.A. Integrating Generative Artificial Intelligence Tools in Higher Education. Pedagogical Education, 2024, vol. 5, issue, 12, pp. 28-35. (In Russian). URL: https://elibrary.ru/chvfwc
- Klepaczkij V.V. Prospects and problems of implementing AI technologies in higher education. Position. Philosophical problems of science and technology, 2024, issue 22, pp. 134-139. (In Russian). URL: https://elibrary.ru/dwsxrr
- Voronczov D.B., Voronczova A.V. On the issue of using artificial intelligence tools in educational practices: research experience. Professional education in Russia and abroad, 2024, issue 3 (55), pp. 174-182. (In Russian). URL: https://elibrary.ru/pdajmj
- Lyz N.A., Kompaniets V.S., Lyz A.E. Artificial intelligence systems supporting student learning and development. Pedagogy of Informatics, 2023, no. 1-2, pp. 48-59. (In Russian). URL: https://elibrary.ru/ghfmvw
- Gilmanshin R.A. The influence of artificial intelligence tools on the modern educational process. Economics and Management: Problems, Solutions, 2024, vol. 8, issue 9 (150), pp. 81-84. (In Russian). URL: https://www.elibrary.ru/agvfgc
- Glukhov A.P. AI agents in tutoring: potential, challenges and integration prospects. Bulletin of pedagogical innovations, 2025, issue 1 (77), pp. 65-74. (In Russian). URL: https://www.elibrary.ru/acdypj
- Tupikova S.E., Pustovedova V.A. Interactive AI agents and scenarios for simulating business negotiations in the framework of studying the discipline “Business Foreign Language” at a university. Bulletin of the Saratov Regional Institute for Education Development, 2025, no. 1 (37), pp. 72-80. (In Russian). URL: https://www.elibrary.ru/xblcxf
- Moorhouse B.L., Wong K.M. Generative Artificial Intelligence and Language Teaching. Cambridge University Press Publ., 2025. DOI: 10.1017/9781009618823
- Martynenko T.S., Dobrinskaya D.E. Social inequality in the era of artificial intelligence: from digital to algorithmic gap. Monitoring of public opinion: economic and social changes, 2021, issue 1 (161), pp. 171-192. (In Russian). URL: https://www.elibrary.ru/zmnkky
- Mora-Cantallops M., Sánchez-Alonso S., García-Barriocanal E. et al. Traceability for trustworthy AI: A review of models and tools. Big Data and Cognitive Computing, 2021, vol. 5, issue 2. pp. 20. DOI: 10.3390/bdcc5020020
- Baksansky O.E., Sorokina S.G. Ethics of artificial intelligence: a balanced approach to development and application. Society: Philosophy, History, Culture, 2025, issue 1 (129), pp. 23-33. (In Russian). URL: https://www.elibrary.ru/avfhgb
- Grafanaki S. Autonomy challenges in the age of big data. Fordham Intell. Prop. Media & Ent. LJ. 2016, 27, p. 803.
- Kartal E. A Comprehensive Study on Bias in Artificial Intelligence Systems: Biased or Unbiased AI, That’s the Question! International Journal of Intelligent Information Technologies, 2022, vol. 18(1), pp.1-23. DOI: 10.4018/IJIIT.309582
- Vologodskiy R.S., Stepanov S.V. Significant aspects of social functioning of AI in the field of higher education system. Sociology of artificial intelligence, 2024, vol. 5, issue. 4, pp. 60-65. (In Russian). URL: https://www.elibrary.ru/pzvdxk
- Berman N.D. The influence of emotional intelligence on students’ academic performance. Proc. “Science innovations. Collection of articles of the II International scientific and practical conference”, Petrozavodsk, International Center for Scientific Partnership “New Science” Publ., 2020, pp. 72-74. (In Russian). URL: https://www.elibrary.ru/qwwhgq
- Mantusov A.B., Sangadzhiev M.M., Goryaeva G.V. One aspect of the formation of critical thinking in connection with the use of AI. Proc. “All-Russian scientific and practical conference with international participation”. Elista, Kalmyk State University named after B.B. Gorodovikov Publ., 2023, pp. 144-153. (In Russian). URL: https://www.elibrary.ru/xjxluj
- Tereshatova E.E. AI cannot be more effective than a teacher … School director, 2023, issue 6 (279), pp. 54-64. (In Russian). URL: https://www.elibrary.ru/qcyoen
- Golovin K.S. The Need for Legal Regulation of the “Black Box” of Artificial Intelligence. Bulletin of Kostroma State University, 2024, vol. 30, issue 3, pp. 290-297. (In Russian). URL: https://www.elibrary.ru/natzgg
- Nikitenko S.V. The Principle of Transparency as an Integral Part of the Legal Regime of Artificial Intelligence. Eurasian Law Journal, 2022, issue 3 (166), pp. 38-41. (In Russian). URL: https://www.elibrary.ru/ossnnf
- Kuteynikov D.L., Izhaev O.A., Zenin S.S. et al. Algorithmic Transparency and Accountability: Legal Approaches to Resolving the “Black Box” Problem. Lex Russica (Russian Law), 2020, vol. 73. issue 6 (163), pp. 139-148. (In Russian). URL: https://www.elibrary.ru/vclbxm
- Khannanov K.A., Pyrnova O.A. Artificial Intelligence and Law: Regulation of Technologies and Responsibility for Decisions. Proc. “International Scientific and Practical Conference”. Kazan, Kazan State Power Engineering University Publ., 2025, pp. 1948-1951. (In Russian). URL: https://www.elibrary.ru/eeajzp
For citation: Berman N.D. Overcoming the challenges of introducing AI agents in the educational environment: focus on ethical aspects and risks. CITISE, 2025, no. 3, pp. 166-177.


