An Artificial Intelligence maturity assessment framework based on international standards

Abstract

In an era dominated by technological integration, Artificial Intelligence (AI) is pivotal across various sectors, driving significant advancements and demanding robust quality measures for its implementations. This paper introduces a novel AI maturity assessment framework designed in alignment with International Standards provided by ISO (International Organization for Standardization) and IEC (International Electrotechnical Commission), specifically with the ISO/IEC 33000 family of standards for process assessment. Our framework aims to provide AI system developers with a structured tool for continuous improvement of their development processes, thereby enhancing the reliability and efficacy of AI applications. To demonstrate the applicability of our proposed framework, we have validated it through a case study in the automotive sector. Specifically, the framework was employed to assess and enhance an AI project to develop a mechanism to determine vehicle behavior from sensor data within the constraints of onboard devices. Our findings identify key improvement points contributing to the iterative enhancement of AI system quality in engineering applications.