Technical
red-team testing
Adversarial assessments focused on privacy.
Definition
Privacy-oriented adversarial testing exercises that simulate attacks or misuse to uncover vulnerabilities such as data leakage, memorization of personal data, or sensitive attribute inference. The Model recommends pre-deployment red-teaming and periodic re-testing (including external reviewers) as part of risk mitigation and monitoring.
Related Terms
pre-deployment testing
Assessments conducted before public release....
risk mitigation measure
Administrative or technical steps to reduce privacy risk....
post-deployment testing
Monitoring and assessments after release....
Model security
Measures to protect models from theft, tampering, or misuse....
data security
Ensuring data is effectively protected and lawfully used through necessary measures....