Human Oversight for High-Risk AI Systems

This article requires providers of high-risk AI systems to design them with human oversight capabilities, ensuring natural persons can effectively monitor and intervene during use. The oversight must prevent or minimize risks to health, safety, or fundamental rights, even in cases of reasonably foreseeable misuse. Providers must enable overseers to understand the system’s capabilities and limitations, detect issues, avoid over-reliance, interpret outputs, and halt operations if necessary. For certain high-risk systems, decisions based on AI identification must be verified by at least two competent individuals.