Test System Engineer - AI - Plans Programs & Strategy - TS/SCI

Job Description

Job Description

Test System Engineer - QA - Plans Programs & Strategy

TULK is a leading boutique consulting firm providing technology and management consulting services to the US Federal Government. Our expert team assists Defense and National Security clients in acquiring, designing, managing, and developing advanced technology systems and business practices to advance their missions. We offer tailored benefits, including medical, dental, and vision insurance, long and short-term disability, flexible work schedules, cash bonuses, access to technology, tuition reimbursement, 401k, and more.

We are looking for applicants with a broad range of skills and interests to join our team. At TULK , we carefully match our employees with assignments that best fit their unique skill sets and career goals. If you're interested in the position below, we encourage you to apply and take the next step in your career with TULK .

Test Systems Engineer (Senior) - Maven AI Program

#ClearanceRequirement: TopSecret/SCI

Overview:

Experienced Test Systems Engineers are key players in Application, System, and Integration Testing across NSG, ASG, and Federal Agencies, ensuring precision in GEOINT. This role centers on offering technical advisory support, embracing innovative AI R&D methods for Test and Evaluation (T&E) Automation and Verification of AI models.

Duties:

• Conduct diagnostic testing on AI/ML systems, gauging performance and efficiency, documenting solutions, and presenting recommendations to the government.
• Develop and manage a technical framework for executing system-level integration specifications.
• Craft tools and methodologies for AI risk analysis and assessment.
• Collaborate with the Government on requirements engineering, solutions engineering, integration, and T&E across NSG, ASG, and Federal Agencies.
• Assist in establishing AI Assurance capabilities, encompassing formal methods for trustworthy eXplainable AI (XAI) and Independent Verification & Validation (IV&V) for AI.
• Provide insights for solution design enhancements based on requirements and new AI technology.
• Formulate algorithms and translate technical specifications into development code.
• Analyze statistics and provide insights for informed decision-making.
• Spearhead algorithm governance ensuring alignment with DoD and ODNI principles.
• Document procedures, execute testing and debugging, and define performance metrics.
• Iteratively refine and validate AI models for precision.
• Define business processes and acceptance criteria for robust testing and evaluation.
• Author test planning documentation, execute test scenarios, and report any anomalies.
• Create deep learning frameworks, optimize models, manage real-time streaming data, and lead distributed computing efforts.
• Develop test procedures for AI model IV&V, collaborating seamlessly with cross-functional teams.
• Evaluate and test the full AI model architecture's acceptance criteria.

Essential Skills:

• Bachelor’s degree or higher in Mathematics, Statistics, Computer Vision, AI, ML, or related STEM field, or equivalent expert-level experience as a Test Systems Engineer.
• Seasoned skills in scripting, statistics, and computer vision.
• Proficiency in tools like JMeter, Jenkins, Docker, Postman, Swagger, Nexus, Apigee, GitHub/GitLab, Java, Bash, Curl, XML, JSON, SQL, Python, Javascript, or AWS/C2S.
• Competence in quantitative and qualitative analysis for AI model assurance.
• Proficient with traditional, Agile, and DevOps practices and testing strategies.
• Mastery of programming languages like Python, C++, Matlab, R, Java.
• Acquainted with geospatial intelligence.
• Familiarity with AI Assurance, T&E, V&V-As-a-Service, and XAI.
• Adeptness with AI technologies and coding evaluations for AI programs.
• Experience in SAFe framework and Model-Based Systems Engineering.

Desirable Skills:

• Demonstrated experience with Atlassian products like Confluence and JIRA.
• Proficiency with NGA Enterprise solutions including CI/CD pipelines and DevSecOps.
• Skilled in engineering solutions using Cloud-based technologies.
• Experience in program transitions and technical capabilities.
• Experience with structured and unstructured Big Data engineering.