Test System Engineer for AI - 12+ Yrs - TS/SCI

Test System Engineer - QA - Plans Programs & Strategy

TULK is a leading boutique consulting firm providing technology and management consulting services to the US Federal Government. Our expert team assists Defense and National Security clients in acquiring, designing, managing, and developing advanced technology systems and business practices to advance their missions. We offer tailored benefits, including medical, dental, and vision insurance, long and short-term disability, flexible work schedules, cash bonuses, access to technology, tuition reimbursement, 401k, and more.

We are looking for applicants with a broad range of skills and interests to join our team. At TULK, we carefully match our employees with assignments that best fit their unique skill sets and career goals. If you're interested in the position below, we encourage you to apply and take the next step in your career with TULK.

Senior-level Test Systems Engineers (US Citizenship Required) lead Application, System, and Integration Testing teams to ensure timely and accurate GEOINT across NSG, ASG, and Federal Agencies. Your focus will be on providing technical advisory support for AI R&D in Test and Evaluation (T&E) Automation and Verification of AI models, identifying innovative capabilities, tools, and techniques to adapt to current AI advancements.

Duties:

• Conduct diagnostic testing on AI/ML systems and applications, measure performance and efficiency, document solutions, and make recommendations to the government.
• Create and maintain a technical framework for executing system-level integration specifications.
• Prepare and present at conferences, webinars, and online events.
• Develop methodologies to analyze and assess AI risks and impacts.
• Assist the Government in requirements engineering, solutions engineering, scheduling, integration, test and evaluation, and analysis across NSG, ASG, and Federal Agencies.
• Advise the Government on solutions designs based on requirements and new technology for AI Assurance and Governance.
• Develop descriptive, diagnostic, predictive, and prescriptive insights/algorithms and translate them into development code.
• Conduct statistical analysis to guide decision-making processes.
• Implement algorithm governance processes to ensure compliance with established principles.
• Document procedures, perform testing, and monitor performance metrics.
• Rapidly iterate AI models for accuracy and repeatability.
• Define business processes and acceptance criteria for testing and evaluation.
• Author test planning documentation, run test scenarios, and report potential issues.
• Develop deep learning frameworks, GPU acceleration, model optimization, real-time streaming data, and distributed computing.
• Create test procedures for AI model verification and validation and collaborate with cross-functional groups for alignment.
• Evaluate the full AI model architecture's acceptance criteria and provide feedback to developer teams and the government.

Required Skills and Experience:

• US Citizenship required.
• Top Secret SCI (TS/SCI) Security Clearance.
• Bachelor's degree or higher in Mathematics, Statistics, Computer Vision, Artificial Intelligence, Machine Learning, or related STEM degree program, or equivalent expert level work experience as a Test Systems Engineer.
• Senior-level experience in scripting, statistics, and computer vision background.
• 10+ years of experience with tools and technologies such as JMeter, Jenkins, Docker, Postman, Swagger, Nexus, Apigee, GitHub/GitLab, Java, Bash, Curl, XML, JSON, SQL, Python, Javascript, or AWS/C2S.
• Strong quantitative and qualitative analysis skills to support AI model assurance.
• Senior-level experience with traditional, Agile, and DevOps development practices and associated testing strategies.
• Test Driven Development experience with programming languages like Python, C++, Matlab, R, Java.
• Experience in the field of geospatial intelligence.
• Knowledge of AI Assurance, T&E or V&V-As-a-Service, and XAI.
• Experience in quality engineering solutions using Automation, Augmentation, and Artificial Intelligence technologies.
• Experience coding and developing test and evaluations for AI programs.
• Experience in SAFe framework and Model Based Systems Engineering.

Desired Skills and Experience:

• Demonstrated experience in Atlassian products like Confluence and JIRA.
• Experience with NGA Enterprise solutions, CI/CD pipeline, and DevSecOps.
• Engineering solutions using Cloud-based technologies.
• Experience with internal and external program transitions and technical capabilities.
• Engineering solutions using structured and unstructured Big Data.

Hashtags:

#SeniorSystemsEngineer #TestSystemsEngineer #AIandML #GEOINT #TestandEvaluation #AIAssurance #Automation #Verification #AIModeling #DataAnalysis #DevOps #GeospatialIntelligence #SAFeFramework #CloudTechnologies #BigData #ModelBasedSystemsEngineering #SecurityClearance #USCitizenship #ITJobs #STEMCareers