Tailored answers, filled into supported job forms.Your tailored resume and answers, filled into supported job forms for you to review.

Download the Chrome Extension
AI AdoptionJob SimulationCertificationsRoadmapsPricing
Sign In
OneRoadmap

OneRoadmap is a career platform built around ORI, its AI career agent. ORI finds overlooked job opportunities, matches them to your profile and shows the skill gaps to close, with roadmaps, challenges, job simulations and certifications to close them. When you are ready, it prepares a tailored resume, application answers and an application strategy, with a cover letter where the application asks for one. The OneRoadmap Chrome extension fills supported application forms for you to review and submit, and you keep track of every application in one place.

gaurav.ghai@oneroadmap.io
Delhi NCR, India

Platform

  • AI Roadmaps
  • Free Certifications
  • Learning Resources
  • Pricing

Training

  • AI Adoption Workshops
  • Expert Sessions
  • Upcoming Events
  • Workshop Gallery

Company

  • About
  • Blog
  • Contact

Legal

  • Privacy
  • Terms
  • Refunds
  • Delete your data

© 2026 OneRoadmap

Operated by Ghai Technologies, India · International operations through One Roadmap Marketing Management, Dubai, UAE

Built for your next chapter.

Open roles

AI / ML · AI-Testing-Engineer

Senior AI Test Engineer

TestPros

Senior · 10+ yrsRemote · USPart TimeListed 6d ago
Apply now

How to stand out for Senior AI Test Engineer at TestPros

Auto Match agent

Let ORI find you the best jobs.

Set up your Auto Match agent once - your target role, level and where you want to work. It searches every day, scores each opening against your profile and resume, and delivers the ones worth applying to, with a prepared application a click away.

Searches every day Scored against your profile Applications prepared for you
Sign in & set up Auto Match agent

Resume & career call

Get your resume reviewed for this role - 30-minute 1:1 call

Line-by-line resume feedback for this application, how to position your Role Readiness, and a clear plan for what to do next - with a OneRoadmap career coach.

Experience Senior · 6+ yrs (10+ years)

About the role

from listing

TestPros delivers innovative independent IT assessment solutions to critical challenges facing the nation and the world. We support the U.S. Federal/State/Local Government and Commercial clients within the continental USA. TestPros is dedicated to making lives better, safer and more secure.

TestPros is seeking a Senior Artificial Intelligence (AI) System Test Engineer with an analytical, customer-focused mindset and experience with the OWASP AI Testing Guide and other guidelines from NIST, ISO, and IEEE.

Start: Future projects in late 2026 or 2027 (not an immediate job opening)

Type: Part-time consulting

Overview

Focus: Software test end evaluation

Regulatory Basis: OWASP AI Testing Guide

Location: Remote, with occasional travel to customer sites or TestPros labs in Sterling, VA

This role evaluates AI systems and software for alignment with the intended functions and features, plus additional assessment focused on AI-specific validation, including model robustness, data integrity, adversarial defense, performance, usability, reliability, security, maintainability, safety, and other aspects of overall quality.

.

Key Responsibilities:

Develop and execute test plans and evaluate software for compliance with the OWASP AI Testing Guide and other guidance, create defect and remediation records, capture test evidence and document defects with clear reproduction steps and severity ratings, report results to senior management and stakeholders.

Required Skills.

Bachelor's degree in computer science, engineering or a related field.

10+ years of experience in Software/System Testing and Quality Engineering (QE), including enterprise-scale transformation programs.

4+ years hands-on experience defining the testing strategy for large scale programs and ensuring requirements traceability throughout the system development lifecycle. Experience should include leading the testing efforts, including experience with all phases of testing: system integration, user acceptance, and performance testing.

A deep understanding of testing planning and associated delivery challenges.

A strong understanding of the various approaches used in testing techniques - white-box, black-box, load testing, coverage testing and regression testing.

Proven experience in defining and executing QE transformation strategy.

Hands-on expertise in Agentic AI / GenAI frameworks (e.g., LangChain, AutoGen, CrewAI, Cursor, etc.).

Experience working in Cloud, Web and Mobile Testing platforms - Saucelabs, Browerstack are preferred.

Hands-on experience with machine learning models.

Experience in Python NLTK or similar natural language processing technology.

Practical experience implementing AI-driven QE solutions such as:

Autonomous test generation

Self-healing automation

Defect prediction and intelligent triaging

Expertise in test automation tools (Selenium, Playwright, Cypress, etc.).

Strong experience with CI/CD pipelines and DevOps integration (GitHub).

Solid understanding of API, microservices, and cloud-native architectures.

Experience evaluating or testing Artificial Intelligence (AI) Large Language Model (LLM)-based application features (e.g., chatbots, copilots, RAG-based systems), including prompt-response validation and hallucination/edge-case testing.

Exposure to AI-assisted defect triage or root-cause analysis tools that reduce manual investigation time.

Experience with cloud platforms (AWS, Azure, GCP) in QE/AI context.

Exposure to self-healing test automation frameworks (AI-driven locator repair, visual AI testing).

Understanding of responsible AI/testing governance principles (bias detection, explainability, model validation) as applied to QE.

Experience contributing to or influencing AI-adoption roadmaps within a testing/QE organization.

Experience implementing testing best practices specific to the test planning and execution processes and gaining buy-in for changes from executives.

Preferred Skills

Experience with test automation tools, and AI assisted test tools

Familiarity with JIRA project/test management system

Knowledge of other IT compliance such as WCAG/Accessibility, IT Security, IT Privacy

Professional certifications in the software testing discipline

Work Environment: Hands-on testing role. Remote-friendly with occasional on-site or hybrid work as needed.

Rate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a guarantee; final compensation is determined by factors such as experience, qualifications, and government contract labor rate requirements and may fall outside the stated range.

Equal Opportunity Employer

TestPros is an equal-opportunity employer and does not discriminate in employment based on race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, retaliation, parental status, military service, or any other non-merit factor.

Offer Considerations

TestPros considers several factors when extending an offer, including but not limited to, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, geographic location, education, and certifications.

Federal Compliance

As a federal contractor, TestPros is subject to all federal and state mandates and/or other customer requirements.

Originally posted on Himalayas

AI-Testing-EngineerQA-EngineerQuality-EngineeringAI-LLM-TestingSoftware-Quality-AssuranceSenior-AI-Product-TesterAI-ML-Testing-EngineerLead-AI-Test-Automation-ArchitectSenior-Test-EngineerSenior-Software-Test-EngineerSenior-Automation-Test-Engineer
Apply on company site

Meet Ori - your career agent on WhatsApp

Find jobs, get your roadmap, check if you're ready for a role and prepare applications - in chat, any language.

Ask Ori about this role
Checking your fit…

Opportunity details

Deadline
Closing in 54d · 9 Jan

As stated by the source. Anything not shown was not stated.

More at TestPros

JPMorgan ChaseTechnologyPreferredFunded

On-site · Ciudad Autónoma de Buenos Aires, Argentina

Senior · 5h ago

Lead Infrastructure Engineer
View role
HarperFunded

On-site · San Francisco

Senior · 5+ yrs · $125K – $170K • Offers Equity • Offers Bonus · 6h ago

Senior Product Manager - Customer Success
View role
Schneider Electric

Remote · US

5+ yrs · $86400–129600 · 7h ago

Advanced- Cooling Technical Support Specialist
View role
Academic Partnerships

Remote · US

Senior · 6+ yrs · 7h ago

Senior Organic Analytics Manager
SQLSEOAEO+13 more
View role
Apply