
This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (CC BY).
ORIGINAL RESEARCH
Classification of risks of using artificial intelligence systems in the field of mental health
Bekhterev National Medical Research Center of Psychiatry and Neurology, Saint Petersburg, Russia
Correspondence should be addressed: Natalia V. Semenova
Bekhtereva St., 3, St. Petersburg, 191019, Russia; ur.verethkeb@gro
Acknowledgements: the authors express their deep gratitude to Elena A. Volskaya, Candidate of Historical Sciences, Advisor to Director of N. A. Semashko National Research Institute of Public Health, Chairman of the Independent Interdisciplinary Committee for the Ethical Review of Clinical Trials, and Chairman of the Interuniversity Ethics Committee for supporting the idea of the article and advising on ethics issues.
Author contribution: Semenova NV — the idea of the article, problem statement, discussion of key substantive and ethical issues, planning and discussion of the article, editing the text of the article, its design; Martynyuk KL — participation in the discussion of the problem, study of world experience and literature on the topic, systematization and generalization of data, participation in discussion of the results, and writing the main text of the article.
Compliance with ethical standards: the ethics committee meeting was not held as the material for publication included theoretical provisions without involvement of patients; the article was prepared in compliance with ethical standards.
- Hołownia-Voloskova M, Tarbastaev A, Golicki D. Population norms of health-related quality of life in Moscow, Russia: the EQ-5D-5L-based survey. Quality of Life Research. 2021; 30(3): 831–840.
- Global Burden of Disease Study 2019 (GBD 2019) Available from URL: https://ghdx.healthdata.org/gbd-2019 (accessed: 11.03.2025).
- Vos T, Lim SS, Abbafati C, Abbas KM, Abbasi M, Abbasifard M, et al. Global Burden of 369 Diseases and Injuries in 204 Countries and Territories, 1990–2019: A Systematic Analysis for the Global Burden of Disease Study 2019. The Lancet. 2020; 396.
- Espejo G, Reiner W, Wenzinger M. Exploring the Role of Artificial Intelligence in Mental Healthcare: Progress, Pitfalls, and Promises. Cureus. 2023; 15(9): e44748.
- Groot J, MacLellan A, Butler M, Todor E, Zulfiqar M, Thackrah T, Clarke C, Brosnan M, Ainsworth B. The Effectiveness of Fully Automated Digital Interventions in Promoting Mental Well-Being in the General Population: Systematic Review and Meta-Analysis. JMIR Ment Health. 2023; 10: e44658.
- Grote T, Berens P. A paradigm shift? — On the ethics of medical large language models. Bioethics. 2024; 38: 383–390.
- Jain G, Pareek S, Carlbring P. Revealing the source: How awareness alters perceptions of AI and human-generated mental health responses. Internet Interv. 2024; 36: 100745.
- Lee EE, Torous J, De Choudhury M, Depp CA, Graham SA, Kim HC, Paulus MP, Krystal JH, Jeste DV. Artificial Intelligence for Mental Health Care: Clinical Applications, Barriers, Facilitators, and Artificial Wisdom. Biol Psychiatry Cogn Neurosci Neuroimaging. 2021; 6(9).
- Rahsepar Meadi M, Bernstein JS, Batelaan N, van Balkom AJL, Metselaar S. Does a lack of emotions make chatbots unfit to be psychotherapists? Bioethics. 2024; 1–8.
- Rogan J, Bucci S, Firth J. Health Care Professionals’ Views on the Use of Passive Sensing, AI, and Machine Learning in Mental Health Care: Systematic Review With Meta-Synthesis. JMIR Ment Health. 2024; 11: e49577.
- Tornero-Costa R, Martinez-Millana A, Azzopardi-Muscat N, Lazeri L, Traver V, Novillo-Ortiz D. Methodological and Quality Flaws in the Use of Artificial Intelligence in Mental Health Research: Systematic Review. JMIR Ment Health. 2023; 10: e42045.
- Vandersluis R, Savulescu J. The selective deployment of AI in healthcare. Bioethics. 2024; 38: 391–400.
- He Y, Yang L, Qian C, Li T, Su Z, Zhang Q, Hou X. Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials. J Med Internet Res. 2023; 2: e43862.
- Postanovlenie Pravitel’stva RF ot 27.12.2012 № 1416 (s izmenenijami na 24.11.2020) «Ob utverzhdenii Pravil gosudarstvennoj registracii medicinskih izdelij». Available from URL: http://government.ru/docs/all/85645/ (accessed: 12.03.2025). Russian.
- Al’jans v sfere iskusstvennogo intellekta. Kodeks jetiki v sfere iskusstvennogo intellekta. Available from URL: https://ethics.a-ai. ru/ (accessed: 11.03.2025). Russian.
- Nacional’nyj centr razvitija iskusstvennogo intellekta pri Pravitel’stve Rossijskoj Federacii. Informacionno-analiticheskaja spravka «Zarubezhnaja praktika ustanovlenija trebovanij k bezopasnosti II» (2023). Available from URL: https://ai.gov.ru/ (accessed: 10.03.2025). Russian.
- PNST 840-2023. Iskusstvennyj intellekt. Obzor jeticheskih i obshhestvennyh aspektov. Available from URL: https://nd.gostinfo.ru/document/7475760.aspx (accessed: 11.03.2025). Russian.
- International Medical Device Regulators Forum. Software as a Medical Device: Framework for Risk Categorization and Corresponding Considerations. Available from URL: https://www.imdrf.org/sites/default/files/docs/imdrf/final/technical/imdrf-tech-140918-samd-framework-risk-categorization-141013. pdf (accessed: 10.03.2025).
- GOST ISO 14971-2021. Izdelija medicinskie. Primenenie menedzhmenta riska k medicinskim izdelijam. Available from URL: https://nd.gostinfo.ru/document/5307378.aspx (accessed: 11.03.2025). Russian.
- GOST R 59525-2021. Informatizacija zdorov’ja. Intellektual’nye metody obrabotki medicinskih dannyh. Osnovnye polozhenija. Available from URL: https://nd.gostinfo.ru/document/6856334.aspx (accessed: 11.03.2025). Russian.