Tailored answers, filled into supported job forms.Your tailored resume and answers, filled into supported job forms for you to review.

Download the Chrome Extension
AI AdoptionFunded CompaniesJob SimulationCertificationsRoadmapsJobsPricing
Sign In
OneRoadmap

OneRoadmap is a career platform built around ORI, its AI career agent. ORI finds overlooked job opportunities, matches them to your profile and shows the skill gaps to close, with roadmaps, challenges, job simulations and certifications to close them. When you are ready, it prepares a tailored resume, application answers and an application strategy, with a cover letter where the application asks for one. The OneRoadmap Chrome extension fills supported application forms for you to review and submit, and you keep track of every application in one place.

gaurav.ghai@oneroadmap.in
Delhi NCR, India

Platform

  • AI Roadmaps
  • Free Certifications
  • Learning Resources
  • Pricing

Training

  • AI Adoption Workshops
  • Expert Sessions
  • Upcoming Events
  • Workshop Gallery

Company

  • About
  • Blog
  • Contact

Legal

  • Privacy
  • Terms
  • Refunds
  • Delete your data

© 2026 OneRoadmap

Operated by Ghai Technologies, India · International operations through One Roadmap Marketing Management, Dubai, UAE

Built for your next chapter.

Open roles

SOFTWARE · Engineering

Senior Software Engineer-I-QA

Sirion

Senior · 4+ yrsOn-site · GurugramListed 1d ago
Apply now

Backed by

Peak XV Partners

HQ

🇮🇳 Lehi, UT, United States

Open roles

14

Experience Senior · 6+ yrs (4–8 years)

About the role

structured by ORI

Skip to content About Sirion Sirion is the world’s leading AI–native Contract Lifecycle Management (CLM) platform, transforming the end-to-end contracting journey for enterprises. With Agentic AI at the core, the platform’s extraction, conversational search, and AI-enhanced negotiation capabilities have…

What you will do

  • Lead the adoption of autonomous AI agents within the QA lifecycle to drive intelligent test case generation, automated bug routing, and predictive defect analysis.
  • Establish testing frameworks for large language models (LLMs), specifically addressing non-deterministic behaviours, prompt vulnerabilities, hallucination detection, and output consistency.
  • Partner closely with developers, data scientists, and product teams to define evaluation metrics (such as RAG accuracy), validation strategies, and guardrails for AI-driven features.
  • Build and scale robust automation frameworks using Selenium (Java) with Page Object Models (POM) and REST Assured to validate both core deterministic workflows and AI model endpoints.
  • Perform API validation using Postman for exploratory, edge-case, and model response scenarios.

What they are looking for

  • Hands-on experience or deep technical familiarity with deploying autonomous AI agents for QA workflows, evaluating RAG (Retrieval-Augmented Generation) pipelines, and validating model outputs.
  • Proven track record of designing test strategies for LLM-powered features and managing applications where inputs and outputs are dynamic and shifting.
  • 4–8 years of QA automation experience in product-based or fast-paced environments.
  • Strong programming skills in Java (OOPs, collections, exception handling).
  • Bachelor’s degree in computer science , Engineering, or a related field.
  • Hands-on experience with Selenium WebDriver (locators, waits, cross-browser testing).
  • Solid experience in API automation using REST Assured, including request/response validation, authentication handling, and data-driven testing.
  • Experience with TestNG (annotations, grouping, parallel runs, reporting).
  • Experience with Maven for build and dependency management.
  • Strong understanding of automation framework design (POM, modular architecture, reusable utilities).
  • Experience in test case design, defect lifecycle management, and JIRA workflows.
  • Good understanding of HTTP protocols, REST APIs, and authentication methods (OAuth, Basic Auth).

Nice to have

  • Exposure to Python for AI scripting, model interaction, or data manipulation is highly preferred.
JavaPythonOOPException HandlingREST APIsHTTPOAuthRAGSeleniumREST AssuredPostmanTestNGMavenJIRA
Full posting text

Skip to content About Sirion Sirion is the world’s leading AI–native Contract Lifecycle Management (CLM) platform, transforming the end-to-end contracting journey for enterprises. With Agentic AI at the core, the platform’s extraction, conversational search, and AI-enhanced negotiation capabilities have revolutionized contracting across Fortune 500 companies like IBM, Coca-Cola, Citi, and GE. With more than 800 employees across the globe, Sirion comprises a team of AI engineers, legal experts, and researchers who are working relentlessly to build reliable and trustworthy CLM solutions for businesses of tomorrow. Recognized by Gartner, IDC, and Spend Matters as a consistent CLM leader, Sirion continues to set the innovation benchmark for the category. For more information, visit www.sirion.ai. Power the Future of AI-Powered Quality Engineering & Why This Role Matters Join us as a QA Automation Engineer and help shape the future of quality assurance for Sirion’s AI-powered Contract Lifecycle Management platform. In this role, you will be at the forefront of validating both traditional enterprise workflows and next-generation AI-driven capabilities, ensuring reliability, scalability, and exceptional user experiences across our products. You will leverage modern automation frameworks, Agentic AI testing tools, and advanced validation techniques to test complex systems, including Generative AI and Large Language Model (LLM) powered features. Working closely with developers, product managers, data scientists, and engineering teams, you will drive automation excellence, establish robust testing strategies, and ensure the highest standards of software quality. Your contributions will directly impact Sirion’s ability to deliver secure, intelligent, and trusted AI-native solutions to global enterprises. How You’ll Make an Impact - Deploy Agentic Testing Tools: Lead the adoption of autonomous AI agents within the QA lifecycle to drive intelligent test case generation, automated bug routing, and predictive defect analysis. - Validate GenAI & LLM Applications: Establish testing frameworks for large language models (LLMs), specifically addressing non-deterministic behaviours, prompt vulnerabilities, hallucination detection, and output consistency. - Collaborate Across AI Ecosystems: Partner closely with developers, data scientists, and product teams to define evaluation metrics (such as RAG accuracy), validation strategies, and guardrails for AI-driven features. - Automate UI & API Testing: Build and scale robust automation frameworks using Selenium (Java) with Page Object Models (POM) and REST Assured to validate both core deterministic workflows and AI model endpoints. - Perform API validation using Postman for exploratory, edge-case, and model response scenarios. - Design and execute TestNG-based test suites with clear reporting and parallel execution. - Integrate and execute automation via Maven within CI/CD pipelines. - Enhance and maintain scalable automation frameworks (UI + API) tailored to handle adaptive, AI-powered system behaviours. - Create and maintain test cases, test data, and automation scripts for new features, leveraging AI-assisted coding tools to accelerate delivery. - Debug failures, identify root causes, and log defects in JIRA with clear reproducibility. - Contribute to framework enhancements that continuously improve automation scalability, efficiency, and runtime intelligence. Skills & Experience You Bring to the Table - Experience with Agentic QA & AI Frameworks: Hands-on experience or deep technical familiarity with deploying autonomous AI agents for QA workflows, evaluating RAG (Retrieval-Augmented Generation) pipelines, and validating model outputs. - Testing Non-Deterministic Systems: Proven track record of designing test strategies for LLM-powered features and managing applications where inputs and outputs are dynamic and shifting. - 4–8 years of QA automation experience in product-based or fast-paced environments. - Strong programming skills in Java (OOPs, collections, exception handling). _Exposure to Python for AI scripting, model interaction, or data manipulation is highly preferred._ - Bachelor’s degree in computer science , Engineering, or a related field. - Hands-on experience with Selenium WebDriver (locators, waits, cross-browser testing). - Solid experience in API automation using REST Assured, including request/response validation, authentication handling, and data-driven testing. - Experience with TestNG (annotations, grouping, parallel runs, reporting). - Experience with Maven for build and dependency management. - Strong understanding of automation framework design (POM, modular architecture, reusable utilities). - Experience in test case design, defect lifecycle management, and JIRA workflows. - Good understanding of HTTP protocols, REST APIs, and authentication methods (OAuth, Basic Auth). - Strong analytical, debugging, and problem-solving skills. - Effective communication and collaboration abilities. Commitment to Diversity and Inclusion We are an equal opportunity employer committed to diversity and inclusion. We do not discriminate based on race, color, gender, religion, national origin, disability, veteran status, or any other protected characteristic. We provide reasonable accommodations as required by law. These principles guide all aspects of employment including recruitment, development, promotions, compensation, and workplace programs. Apply for this job First name \* Last name \* Email \* Contact number \* Current location (City) \* LinkedIn profile URL \* Resume (PDF/DOC) \* Cover letter (optional) We will use the information you provide in accordance with our Privacy Policy. Submit Application

Apply on company site

Meet Ori - your career agent on WhatsApp

Find jobs, get your roadmap, check if you're ready for a role and prepare applications - in chat, any language.

Ask Ori about this role
Checking your fit…
Sirion

Software Development

Sirion is an AI-native contract lifecycle management platform for enterprise contracting and supplier management.

Backed by Peak XV Partners

Company pageWebsite

More at Sirion

SirionEngineeringFunded

On-site · Gurugram

2–5 yrs · 1d ago

Software Engineer-II-QA
QA automationOOPscollections+13 more
View role
SirionEngineeringFunded

On-site · Gurugram

29d ago

Devops Engineer
View role
Apply