
This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (CC BY).
OPINION
The concept of predictable harm in development of AI-powered medical devices
Kazan Innovative University named after VG Timiryasov, Kazan, Russia
Correspondence should be addressed: Ildar R. Begishev
42 Moskovskaya St., Kazan, Russia, 420111; ur.liam@vehsigeb
Financing: the work was carried out under the grant from the Academy of Sciences of the Republic of Tatarstan, provided to young candidates of sciences (postdoctoral fellows) so that they could defend their doctoral dissertation, perform research and labor functions in scientific and educational organizations of the Republic of Tatarstan within the framework of the Scientific and Technological Development of the Republic of Tatarstan State Program.
Acknowledgements: the authors express their sincere gratitude to the Academy of Sciences of the Republic of Tatarstan for financial support of this study based on the results of a competitive selection (grant No. 153/2024-PD dated December 16, 2024) for ‘Ensuring the technological sovereignty of the healthcare system by criminal means’ research project, as well as deep gratitude to the staff of the Scientific Research Institute of Digital Technologies and Law of Kazan Innovative University named after Timiryasov VG for valuable consultations and constructive discussion of the conceptual provisions of the study.
Author contribution: Begishev IR — research conceptualization; development of predictable harm theoretical foundations; analysis of specific risks associated with using artificial intelligence in medical devices; systematization of predictable harm typology; research of legal framework for regulating AI systems in healthcare with various jurisdictions; formulation of research conclusions; preparation of the manuscript initial version; Shutova AA — development of a methodology for predicting and preventing predictable harm; creation of a matrix for assessing predictable harm at various stages of medical AI system life cycle; developing recommendations for practical implementation of predictable harm concept; analysis of literature sources; editing and critical revision of the manuscript with introduction of valuable intellectual content; visualization of research (making tables).
Compliance with ethical standards: a meeting of the ethics committee was not required, since this study is theoretical and methodological in nature and analyzes open literature sources and regulatory legal documents, without conducting experiments involving humans or animals and without using personal patient data.
- Grand View Research. Artificial Intelligence in Healthcare Market Size Report, 2021–2028. Available from URL: https://www.grandviewresearch.com/industry-analysis/artificial-intelligence-ai-healthcare-market (accessed: 01.05.2025).
- Prikaz Ministerstva zdravookhraneniya Rossiyskoy Federatsii ot 7 iyulya 2020 g. № 686n «O vnesenii izmeneniy v prilozheniya № 1 i № 2 k prikazu Ministerstva zdravookhraneniya Rossiyskoy Federatsii ot 6 iyunya 2012 g. № 4n «Ob utverzhdenii nomenklaturnoy klassifikatsii meditsinskikh izdeliy» Ofitsial’nyy internet-portal zakona informatsii. Elektron. dan. Available from URL: https://www.pravo.gov.ru, svobodnyy. № publikatsii: 0001202008100015 (accessed: 10.05.2025). Russian.
- Pis’mo Federal’noy sluzhby po nadzoru v sfere zdravookhraneniya ot 13 fevralya 2020 g. № 02I-297/20 «O programmnom obespechenii». [Tekst pis’ma opublikovan ne byl]. Russian.
- «Software as a Medical Device»: Possible Framework for Risk Categorization and Corresponding Considerations. Available from URL: https://www.imdrf.org/sites/default/files/docs/imdrf/final/technical/imdrf-tech-140918-samd-framework-risk-categorization-141013.pdf (accessed: 10.05.2025).
- Kodeks etiki v sfere II v meditsine i zdravookhranenii. Available from URL: https://ethics.a-ai.ru/ethics-of-medicine (accessed: 10.05.2025). Russian.
- World Health Organization. Ethics and governance of artificial intelligence for health: WHO guidance. Available from URL: https://www.who.int/publications/i/item/9789240029200 (accessed: 01.05.2025).
- European Parliament. Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on medical devices, amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and Regulation (EC) No 1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC (Text with EEA relevance.). Available from URL: https://eur-lex.europa.eu/eli/reg/2017/745/oj/eng (accessed: 01.05.2025).
- European Commission. Proposal for a Regulation of the European Parliament and of the Council laying down harmonised rules on Artificial Intelligence (Artificial Intelligence Act). Available from URL: https://digital-s trategy.ec.europa.eu/en/library/proposal-regulation-laying-down-harmonised-rules-artificial-intelligence (accessed: 01.05.2025).
- U. S. Food and Drug Administration. Artificial Intelligence and Machine Learning (AI/ML) Software as a Medical Device Action Plan. Available from URL: https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-and-machine-learning-software-medical-device (accessed: 01.05.2025).