Software Test & Evaluation Specialist
Plans, prepares, and performs testing, evaluation, verification, and validation of software to evaluate results against specifications, requirements, and operational need.
Core KSATs
KSAT ID | Description | KSAT |
---|---|---|
16 | Knowledge of capabilities and requirements analysis. |
Knowledge |
22 | * Knowledge of computer networking concepts and protocols, and network security methodologies. |
Knowledge |
108 | * Knowledge of risk management processes (e.g., methods for assessing and mitigating risk). |
Knowledge |
130 | Knowledge of systems testing and evaluation methods. |
Knowledge |
130A | Knowledge of systems security testing and evaluation methods. |
Knowledge |
144 | Knowledge of the systems engineering process. |
Knowledge |
169 | Skill in conducting test events. |
Skill |
176 | Skill in designing a data analysis structure (i.e., the types of data your test must generate and how to analyze those data). |
Skill |
182 | Skill in determining an appropriate level of test rigor for a given system. |
Skill |
190 | Skill in developing operations-based testing scenarios. |
Skill |
220 | Skill in systems integration testing. |
Skill |
239 | Skill in writing test plans. |
Skill |
412A | Analyze the results of software, hardware, or interoperability testing. |
Task |
414 | Analyze user needs and software requirements to determine feasibility of design within time and cost constraints. |
Task |
452 | Conduct functional and connectivity testing to ensure continuing operability. |
Task |
508 | Determine level of assurance of developed capabilities based on test results. |
Task |
515A | Develop software system testing and validation procedures, programming, and documentation. |
Task |
550 | Develop test plans to address specifications and requirements. |
Task |
694 | Make recommendations based on test results. |
Task |
748A | Perform developmental testing on systems under development. |
Task |
757A | Perform interoperability testing on systems exchanging electronic information with other systems. |
Task |
761A | Perform operational testing. |
Task |
858A | Test, evaluate, and verify hardware and/or software to determine compliance with defined specifications and requirements. |
Task |
858B | Record and manage test data. |
Task |
950 | Skill in evaluating test plans for applicability and completeness. |
Skill |
951 | Determine scope, infrastructure, resources, and data sample size to ensure system requirements are adequately demonstrated. |
Task |
978A | Knowledge of root cause analysis techniques. |
Knowledge |
1020A | Skill in secure test plan design (e. g. unit, integration, system, acceptance). |
Skill |
1157 | * Knowledge of national and international laws, regulations, policies, and ethics as they relate to cybersecurity. |
Knowledge |
1158 | * Knowledge of cybersecurity principles. |
Knowledge |
1159 | * Knowledge of cyber threats and vulnerabilities. |
Knowledge |
5650 | Validate specifications and requirements for testability. |
Task |
5866A | Create or customize existing Test and Evaluation Master Plans (TEMPs) for systems. |
Task |
5877A | Develop possible solutions for technical risks and limitations of planned tests. |
Task |
5914 | Report test and evaluation deficiencies and possible solutions to appropriate personnel. |
Task |
5920A | Test components to ensure they work as intended in a variety of scenarios for all aspects of the application. |
Task |
5933 | Conduct automated testing for acceptance testing, functional testing, integration testing, interoperability testing, load/stress testing, performance testing, regression testing, and unit testing. |
Task |
5934 | Develop and maintain a tool framework for automated test and evaluation. |
Task |
5936 | Evaluate reliability, availability, and maintainability data. |
Task |
5937 | Assess the system’s effectiveness and suitability for meeting user need and based on test and evaluation results. |
Task |
6020 | Ability to analyze test data. |
Ability |
6060 | Ability to collect, verify, and validate test data. |
Ability |
6170 | Ability to translate data and test results into evaluative conclusions. |
Ability |
6430 | Knowledge of Test & Evaluation processes. |
Knowledge |
6530 | Skill in designing and documenting overall program Test & Evaluation strategies. |
Skill |
6630 | Skill in preparing Test & Evaluation reports. |
Skill |
6900 | * Knowledge of specific operational impacts of cybersecurity lapses. |
Knowledge |
6935 | * Knowledge of cloud computing service models Software as a Service (SaaS), Infrastructure as a Service (IaaS), and Platform as a Service (PaaS). |
Knowledge |
6938 | * Knowledge of cloud computing deployment models in private, public, and hybrid environment and the difference between on-premises and off-premises environments. |
Knowledge |
7003A | Knowledge of security risks, threats, and vulnerabilities and potential risk mitigation solutions. |
Knowledge |
7004A | Knowledge of Test & Evaluation frameworks. |
Knowledge |
7006A | Knowledge of best practices from industry and academia in test design activities for verification and validation of systems. |
Knowledge |
7025A | Knowledge of how software solutions integrate with cloud or other IT infrastructure. |
Knowledge |
7044 | Knowledge of testing, evaluation, validation, and verification (T&E V&V) tools and procedures to ensure systems are working as intended. |
Knowledge |
7054A | Knowledge of tools for testing the robustness and resilience of software products and solutions. |
Knowledge |
7077A | Skill in translating operation requirements for systems into testing requirements. |
Skill |
7085 | Knowledge of software environments (e.g., development, testing, integration, production, etc.) and appropriate T&E application in those environments. |
Knowledge |
7086 | Ability to construct, maintain, and conduct testing in various test environments. |
Ability |
Additional KSATs
KSAT ID | Description | KSAT |
---|---|---|
40 | Knowledge of organization’s evaluation and validation requirements. |
Knowledge |
53 | Knowledge of the Security Assessment and Authorization process. |
Knowledge |
81A | Knowledge of network protocols such as TCP/IP, Dynamic Host Configuration, Domain Name System (DNS), and directory services. |
Knowledge |
83 | Knowledge of network hardware devices and functions. |
Knowledge |
238A | Skill in writing code in a currently supported programming language (e.g., Java, C++). |
Skill |
393A | Administer test bed(s), and test and evaluate applications, hardware infrastructure, rules/signatures, access controls, and configurations of platforms managed by service provider(s). |
Task |
431A | Build, assess, and modify product prototypes using working models or theoretical models. |
Task |
874 | Utilize models and simulations to analyze or predict system performance under different operating conditions. |
Task |
904 | Knowledge of interpreted and compiled computer languages. |
Knowledge |
965 | Knowledge of organization’s risk tolerance and/or risk management approach. |
Knowledge |
980A | Skill in performing root cause analysis. |
Skill |
5910A | Provide quality assurance of software products throughout their lifecycle. |
Task |
5935 | Perform usability surveys on operators/users of the system. |
Task |
5938 | Integrate digital engineering models and data into test designs. |
Task |
6500 | Skill in conducting Test Readiness Reviews. |
Skill |
6580 | Skill in identifying Test & Evaluation infrastructure (people, ranges, tools, instrumentation) requirements. |
Skill |
6600 | Skill in managing test assets, test resources, and test personnel to ensure effective completion of test events. |
Skill |
6641 | Skill in providing Test & Evaluation resource estimate. |
Skill |
7009A | Knowledge of coding and scripting in languages that support software development and use. |
Knowledge |
7012A | Knowledge of current test standards and safety standards that are applicable to software development. |
Knowledge |
7028A | Knowledge of how to automate development, testing, security, and deployment of software to the DoD. |
Knowledge |
7034A | Knowledge of interactions and integration of DataOps, MLOps, and DevSecOps solution. |
Knowledge |
7036A | Knowledge of laws, regulations, and policies related to software development, cybersecurity, data security/privacy, and use of publicly procured data for government. |
Knowledge |
7070A | Skill in integrating software Test & Evaluation frameworks into test strategies for specific projects. |
Skill |
7083 | Ability to measure human systems interaction (usability, workload, system trust). |
Ability |
7084 | Ability to evaluate user training and documentation update processes. |
Ability |