Software Test & Evaluation Specialist

Software Test & Evaluation Specialist Work Role ID: 673 (NIST: N/A) Workforce Element: Software Engineering

Plans, prepares, and performs testing, evaluation, verification, and validation of software to evaluate results against specifications, requirements, and operational need.


Items denoted by a * are CORE KSATs for every Work Role, while other CORE KSATs vary by Work Role.

Core KSATs

KSAT ID Description KSAT
16

Knowledge of capabilities and requirements analysis.

Knowledge
22

* Knowledge of computer networking concepts and protocols, and network security methodologies.

Knowledge
108

* Knowledge of risk management processes (e.g., methods for assessing and mitigating risk).

Knowledge
130

Knowledge of systems testing and evaluation methods.

Knowledge
130A

Knowledge of systems security testing and evaluation methods.

Knowledge
144

Knowledge of the systems engineering process.

Knowledge
169

Skill in conducting test events.

Skill
176

Skill in designing a data analysis structure (i.e., the types of data your test must generate and how to analyze those data).

Skill
182

Skill in determining an appropriate level of test rigor for a given system.

Skill
190

Skill in developing operations-based testing scenarios.

Skill
220

Skill in systems integration testing.

Skill
239

Skill in writing test plans.

Skill
412A

Analyze the results of software, hardware, or interoperability testing.

Task
414

Analyze user needs and software requirements to determine feasibility of design within time and cost constraints.

Task
452

Conduct functional and connectivity testing to ensure continuing operability.

Task
508

Determine level of assurance of developed capabilities based on test results.

Task
515A

Develop software system testing and validation procedures, programming, and documentation.

Task
550

Develop test plans to address specifications and requirements.

Task
694

Make recommendations based on test results.

Task
748A

Perform developmental testing on systems under development.

Task
757A

Perform interoperability testing on systems exchanging electronic information with other systems.

Task
761A

Perform operational testing.

Task
858A

Test, evaluate, and verify hardware and/or software to determine compliance with defined specifications and requirements.

Task
858B

Record and manage test data.

Task
950

Skill in evaluating test plans for applicability and completeness.

Skill
951

Determine scope, infrastructure, resources, and data sample size to ensure system requirements are adequately demonstrated.

Task
978A

Knowledge of root cause analysis techniques.

Knowledge
1020A

Skill in secure test plan design (e. g. unit, integration, system, acceptance).

Skill
1157

* Knowledge of national and international laws, regulations, policies, and ethics as they relate to cybersecurity.

Knowledge
1158

* Knowledge of cybersecurity principles.

Knowledge
1159

* Knowledge of cyber threats and vulnerabilities.

Knowledge
5650

Validate specifications and requirements for testability.

Task
5866A

Create or customize existing Test and Evaluation Master Plans (TEMPs) for systems.

Task
5877A

Develop possible solutions for technical risks and limitations of planned tests.

Task
5914

Report test and evaluation deficiencies and possible solutions to appropriate personnel.

Task
5920A

Test components to ensure they work as intended in a variety of scenarios for all aspects of the application.

Task
5933

Conduct automated testing for acceptance testing, functional testing, integration testing, interoperability testing, load/stress testing, performance testing, regression testing, and unit testing.

Task
5934

Develop and maintain a tool framework for automated test and evaluation.

Task
5936

Evaluate reliability, availability, and maintainability data.

Task
5937

Assess the system’s effectiveness and suitability for meeting user need and based on test and evaluation results.

Task
6020

Ability to analyze test data.

Ability
6060

Ability to collect, verify, and validate test data.

Ability
6170

Ability to translate data and test results into evaluative conclusions.

Ability
6430

Knowledge of Test & Evaluation processes.

Knowledge
6530

Skill in designing and documenting overall program Test & Evaluation strategies.

Skill
6630

Skill in preparing Test & Evaluation reports.

Skill
6900

* Knowledge of specific operational impacts of cybersecurity lapses.

Knowledge
6935

* Knowledge of cloud computing service models Software as a Service (SaaS), Infrastructure as a Service (IaaS), and Platform as a Service (PaaS).

Knowledge
6938

* Knowledge of cloud computing deployment models in private, public, and hybrid environment and the difference between on-premises and off-premises environments.

Knowledge
7003A

Knowledge of security risks, threats, and vulnerabilities and potential risk mitigation solutions.

Knowledge
7004A

Knowledge of Test & Evaluation frameworks.

Knowledge
7006A

Knowledge of best practices from industry and academia in test design activities for verification and validation of systems.

Knowledge
7025A

Knowledge of how software solutions integrate with cloud or other IT infrastructure.

Knowledge
7044

Knowledge of testing, evaluation, validation, and verification (T&E V&V) tools and procedures to ensure systems are working as intended.

Knowledge
7054A

Knowledge of tools for testing the robustness and resilience of software products and solutions.

Knowledge
7077A

Skill in translating operation requirements for systems into testing requirements.

Skill
7085

Knowledge of software environments (e.g., development, testing, integration, production, etc.) and appropriate T&E application in those environments.

Knowledge
7086

Ability to construct, maintain, and conduct testing in various test environments.

Ability

Additional KSATs

KSAT ID Description KSAT
40

Knowledge of organization’s evaluation and validation requirements.

Knowledge
53

Knowledge of the Security Assessment and Authorization process.

Knowledge
81A

Knowledge of network protocols such as TCP/IP, Dynamic Host Configuration, Domain Name System (DNS), and directory services.

Knowledge
83

Knowledge of network hardware devices and functions.

Knowledge
238A

Skill in writing code in a currently supported programming language (e.g., Java, C++).

Skill
393A

Administer test bed(s), and test and evaluate applications, hardware infrastructure, rules/signatures, access controls, and configurations of platforms managed by service provider(s).

Task
431A

Build, assess, and modify product prototypes using working models or theoretical models.

Task
874

Utilize models and simulations to analyze or predict system performance under different operating conditions.

Task
904

Knowledge of interpreted and compiled computer languages.

Knowledge
965

Knowledge of organization’s risk tolerance and/or risk management approach.

Knowledge
980A

Skill in performing root cause analysis.

Skill
5910A

Provide quality assurance of software products throughout their lifecycle.

Task
5935

Perform usability surveys on operators/users of the system.

Task
5938

Integrate digital engineering models and data into test designs.

Task
6500

Skill in conducting Test Readiness Reviews.

Skill
6580

Skill in identifying Test & Evaluation infrastructure (people, ranges, tools, instrumentation) requirements.

Skill
6600

Skill in managing test assets, test resources, and test personnel to ensure effective completion of test events.

Skill
6641

Skill in providing Test & Evaluation resource estimate.

Skill
7009A

Knowledge of coding and scripting in languages that support software development and use.

Knowledge
7012A

Knowledge of current test standards and safety standards that are applicable to software development.

Knowledge
7028A

Knowledge of how to automate development, testing, security, and deployment of software to the DoD.

Knowledge
7034A

Knowledge of interactions and integration of DataOps, MLOps, and DevSecOps solution.

Knowledge
7036A

Knowledge of laws, regulations, and policies related to software development, cybersecurity, data security/privacy, and use of publicly procured data for government.

Knowledge
7070A

Skill in integrating software Test & Evaluation frameworks into test strategies for specific projects.

Skill
7083

Ability to measure human systems interaction (usability, workload, system trust).

Ability
7084

Ability to evaluate user training and documentation update processes.

Ability