AI Risk & Ethics Specialist

AI Risk & Ethics Specialist Work Role ID: 733 (NIST: N/A) Workforce Element: Data/AI

Educates those involved in the development of AI and conducts assessments on the technical and societal risks across the lifecycle of AI solutions from acquisition or design to deployment and use.


Items denoted by a * are CORE KSATs for every Work Role, while other CORE KSATs vary by Work Role.

Core KSATs

KSAT ID Description KSAT
22

* Knowledge of computer networking concepts and protocols, and network security methodologies.

Knowledge
108

* Knowledge of risk management processes (e.g., methods for assessing and mitigating risk).

Knowledge
537A

Develop methods to monitor and measure risk and assurance efforts on a continuous basis.

Task
765B

Perform AI architecture security reviews, identify gaps, and develop a risk management plan to address issues.

Task
952

Knowledge of emerging security issues, risks, and vulnerabilities.

Knowledge
963A

Ensure risk mitigation plans of action and milestones are in place.

Task
1000B

Ensure that AI design and development activities are properly documented and updated.

Task
1157

* Knowledge of national and international laws, regulations, policies, and ethics as they relate to cybersecurity.

Knowledge
1158

* Knowledge of cybersecurity principles.

Knowledge
1159

* Knowledge of cyber threats and vulnerabilities.

Knowledge
5854

Collaborate with appropriate personnel to address Personal Health Information (PHI), Personally Identifiable Information (PII), and other data privacy and data resusability concerns for AI solutions.

Task
5856

Communicate the results of AI risk assessments to relevant stakeholders.

Task
5860

Coordinate with appropriate personnel to identify methods for users and developers to report concerns about the implementation of DoD AI Ethical Principles.

Task
5863

Create and/or maintain processes to ensure data management efforts comply with AI ethical principles.

Task
5873

Determine methods and metrics for quantitative and qualitative measurement of AI risks so that sensitivity, specificity, likelihood, confidence levels, and other metrics are identified, documented, and applied.

Task
5878

Develop risk mitigation strategies to ensure enumerated risks are prioritized, mitigated, shared, transferred, and/or accepted.

TAsk
5879

Direct and/or support organizational and project-level AI risk management activities.

Task
5881

Ensure risk management responsibilities are clearly defined, assigned, and communicated to relevant stakeholders.

Task
5889

Identify and submit exemplary AI use cases, best practices, failure modes, and risk mitigation strategies, including after-action reports.

Task
5893

Implement Responsible AI best practices and standards within AI solutions according to the DoD AI Ethical Principles, Responsible AI Guidelines, and/or any other pertinent laws.

Task
5896

Maintain current knowledge of advancements in DoD AI Ethical Principles and Responsible AI.

Task
5900

Measure the compliance of AI tools with DoD AI Ethical Principles.

Task
5904

Perform risk assessment on AI applications to identify technical, societal, organizational, and mission risks.

Task
6311

Knowledge of machine learning theory and principles.

Knowledge
6900

* Knowledge of specific operational impacts of cybersecurity lapses.

Knowledge
6935

* Knowledge of cloud computing service models Software as a Service (SaaS), Infrastructure as a Service (IaaS), and Platform as a Service (PaaS).

Knowledge
6938

* Knowledge of cloud computing deployment models in private, public, and hybrid environment and the difference between on-premises and off-premises environments.

Knowledge
7003

Knowledge of AI security risks, threats, and vulnerabilities and potential risk mitigation solutions.

Knowledge
7020

Knowledge of DoD AI Ethical Principles (e.g., responsible, equitable, traceable, reliable, and governable).

Knowledge
7021

Knowledge of emerging trends and future use cases of AI.

Knowledge
7024

Knowledge of how AI is developed and operated.

Knowledge
7034

Knowledge of interactions and integration of DataOps, MLOps, and DevSecOps in AI.

Knowledge
7036

Knowledge of laws, regulations, and policies related to AI, data security/privacy, and use of publicly procured data for government.

Knowledge
7038

Knowledge of metrics to evaluate the effectiveness of machine learning models.

Knowledge
7040

Knowledge of Personal Health Information (PHI), Personally Identifiable Information (PII), and other data privacy and data reusability considerations for AI solutions.

Knowledge
7041

Knowledge of remedies against unintended bias in AI solutions.

Knowledge
7045

Knowledge of the AI lifecycle.

Knowledge
7048

Knowledge of the benefits and limitations of AI capabilities.

Knowledge
7051

Knowledge of the possible impacts of machine learning blind spots and edge cases.

Knowledge
7052

Knowledge of the principles, methods, and tools used for risk and bias assessment and mitigation, including assessment of failures and their consequences.

Knowledge
7056

Skill in assessing AI capabilities for bias or ethical concerns.

Skill
7064

Skill in developing solutions and/or recommendations to minimize negative impacts of machine learning, especially for edge cases.

Skill
7065

Skill in explaining AI concepts and terminology.

Skill
7067

Skill in identifying low-probability, high-impact risks in machine learning training data sets.

Skill
7068

Skill in identifying organizational and project-level AI risks, including AI security risks and requirements.

Skill
7069

Skill in identifying risk over the lifespan of an AI solution.

Skill
7075

Skill in testing and evaluating machine learning algorithms or AI solutions.

Skill

Additional KSATs

KSAT ID Description KSAT
942

Knowledge of the organization’s core business/mission processes.

Knowledge
5905

Perform risk assessment whenever an AI application or AI-enabled system undergoes a major change, when emergent behaviors are detected, and/or unintended consequences are reported.

Task
7044

Knowledge of testing, evaluation, validation, and verification (T&E V&V) tools and procedures to ensure systems are working as intended.

Knowledge