Critical safety incident

An event such as unauthorized access to unreleased model weights causing injury, the manifestation of a catastrophic risk, loss of model control, or deceptive model behavior that subverts developer controls; such incidents trigger specified reporting timelines to Cal OES and other obligations.

A critical safety incident is defined as unauthorized access, modification, or exfiltration of a frontier model's model weights resulting in death or bodily injury. It also includes harm stemming from the materialization of a catastrophic risk or a loss of control over the AI system by its developers or users.