Tailored answers, filled into supported job forms.Your tailored resume and answers, filled into supported job forms for you to review.

Download the Chrome Extension
AI AdoptionJob SimulationCertificationsRoadmapsPricing
Sign In
OneRoadmap

OneRoadmap is a career platform built around ORI, its AI career agent. ORI finds overlooked job opportunities, matches them to your profile and shows the skill gaps to close, with roadmaps, challenges, job simulations and certifications to close them. When you are ready, it prepares a tailored resume, application answers and an application strategy, with a cover letter where the application asks for one. The OneRoadmap Chrome extension fills supported application forms for you to review and submit, and you keep track of every application in one place.

gaurav.ghai@oneroadmap.io
Delhi NCR, India

Platform

  • AI Roadmaps
  • Free Certifications
  • Learning Resources
  • Pricing

Training

  • AI Adoption Workshops
  • Expert Sessions
  • Upcoming Events
  • Workshop Gallery

Company

  • About
  • Blog
  • Contact

Legal

  • Privacy
  • Terms
  • Refunds
  • Delete your data

© 2026 OneRoadmap

Operated by Ghai Technologies, India · International operations through One Roadmap Marketing Management, Dubai, UAE

Built for your next chapter.

Open roles

AI / ML

TechOps-CloudOps-AI-ML Platform Operations Senior Engineer

EY

Senior · 5+ yrsOn-site · Trivandrum, KL, IN, 695581Listed 3d ago
Apply now

Backed by

VC portfolio

HQ

🇬🇧 London, United Kingdom

Open roles

12303

How to stand out for TechOps-CloudOps-AI-ML Platform Operations Senior Engineer at EY

Auto Match agent

Let ORI find you the best jobs.

Set up your Auto Match agent once - your target role, level and where you want to work. It searches every day, scores each opening against your profile and resume, and delivers the ones worth applying to, with a prepared application a click away.

Searches every day Scored against your profile Applications prepared for you
Sign in & set up Auto Match agent

Resume & career call

Get your resume reviewed for this role - 30-minute 1:1 call

Line-by-line resume feedback for this application, how to position your Role Readiness, and a clear plan for what to do next - with a OneRoadmap career coach.

Experience Senior · 6+ yrs (5–8 years)

About the role

from listing

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

TechOps - CloudOps – AI/ML Platform Operations Engineer: Senior

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

About Global Delivery Services

Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.

Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.

Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.

Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.

Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.

The opportunity

We are looking for a seasoned and proactive Senior AI/ML Platform Operations Engineer to operate, support, and continuously improve enterprise machine learning and generative AI platforms. The role will focus on MLOps and LLMOps across model deployment, monitoring, API and endpoint operations, model pipelines, prompt and model configuration, observability, and incident resolution. The engineer will act as a technical escalation point for production AI services and work closely with data scientists, ML engineers, application teams, cloud platform teams, security, DevOps, and business stakeholders to deliver reliable, secure, scalable, and cost-effective AI capabilities.

Your key responsibilities

Provide day-to-day production and operational support for machine learning, generative AI, and large language model platforms across development, test, staging, and production environments.

Deploy, configure, validate, and support machine learning models, foundation models, embedding models, rerankers, and associated inference services using controlled MLOps and LLMOps practices.

Monitor real-time and batch inference workloads, APIs, endpoints, model pipelines, queues, scheduled jobs, and dependent services, and restore failed or degraded services within agreed SLAs.

Troubleshoot endpoint errors, latency, throttling, token limits, authentication failures, networking issues, dependency conflicts, model-loading errors, memory constraints, and scaling problems.

Operate model training, evaluation, registration, approval, deployment, rollback, and retirement pipelines with traceability across model and environment versions.

Support prompt templates, system instructions, model parameters, routing rules, guardrails, content filters, retrieval configuration, tool connections, and environment-specific configuration.

Implement and maintain observability for model quality, response latency, throughput, error rate, availability, token consumption, cost, drift, data quality, hallucination risk, safety events, and user feedback.

Investigate production incidents using application, model, prompt, API gateway, orchestration, cloud service, infrastructure, and security logs, and coordinate service recovery.

Perform root cause analysis for recurring incidents and implement corrective actions, preventive alerts, automated recovery, runbook improvements, and platform engineering enhancements.

Develop and maintain Python utilities, automation scripts, health checks, deployment tooling, test harnesses, evaluation workflows, and operational dashboards.

Support enterprise integrations with OpenAI services, Azure OpenAI where applicable, AWS Bedrock, model gateways, vector stores, API gateways, identity providers, secrets management, and monitoring platforms.

Ensure secure handling of model endpoints, API keys, service identities, secrets, private networking, customer data, prompts, responses, and model artifacts.

Support capacity planning, autoscaling, quota management, rate-limit management, GPU or accelerator utilization, token forecasting, and cost optimization for AI workloads.

Coordinate controlled releases using Git and CI/CD, including testing evidence, model and prompt versioning, approvals, deployment validation, rollback planning, and post-release monitoring.

Manage complex incidents, service requests, problems, and changes, and mentor junior engineers in troubleshooting, platform operations, and operational best practices.

Create and maintain runbooks, SOPs, architecture and dependency records, known-error articles, monitoring standards, escalation paths, and support knowledge bases.

Responsible for decision-making, optimizing processes, resource management, and overseeing team management as needed for task execution.

Accountable for allocating personnel, supervising team members, assigning tasks, ensuring that the team has the necessary tools and support to succeed in their roles and optimizing and evaluating their performance to meet organizational goals.

Skills and attributes for success

Strong hands-on knowledge of MLOps practices covering experiment tracking, model packaging, model registry, validation, promotion, deployment, monitoring, rollback, and lifecycle governance.

Strong understanding of LLMOps, including foundation model access, prompt and configuration management, evaluation, observability, retrieval-augmented generation, guardrails, endpoint operations, and cost controls.

Experience operating model APIs and endpoints, including authentication, authorization, throttling, load management, autoscaling, latency troubleshooting, retries, timeouts, and high availability.

Strong Python skills for platform automation, API integration, log analysis, operational tooling, testing, and incident diagnosis.

Working knowledge of OpenAI APIs and AWS Bedrock services, including model invocation, embeddings, streaming responses, configuration, quotas, monitoring, and security.

Understanding of machine learning and generative AI evaluation methods, including accuracy and task metrics, groundedness, relevance, toxicity and safety checks, drift, regression testing, and human evaluation.

Ability to interpret distributed application, model, API, cloud, container, orchestration, network, and security telemetry to isolate failures across multiple technology layers.

Strong incident management, root cause analysis, problem-solving, and production change-management skills.

Clear communication and stakeholder-management skills, including the ability to explain operational risk, business impact, recovery status, and remediation plans.

Ability to mentor engineers, coordinate technical recovery, review operational designs, and promote reliability and engineering standards.

To qualify for the role, you must have

Bachelor’s degree in computer science, artificial intelligence, machine learning, data science, engineering, or a related discipline, or equivalent professional experience.

5–8 years of experience in platform engineering, DevOps, data engineering, machine learning engineering, cloud operations, or production support, including at least 2 years supporting ML or generative AI workloads.

Hands-on experience implementing or operating MLOps pipelines and production model deployments.

Practical experience with LLMOps, including model endpoints, prompt or model configuration, evaluation, monitoring, observability, and incident troubleshooting.

Experience supporting OpenAI-based services, AWS Bedrock, or comparable enterprise foundation-model platforms.

Strong Python experience for automation, API consumption, operational tooling, testing, and troubleshooting.

Experience with CI/CD, infrastructure automation, containerized workloads, cloud monitoring, secrets management, and identity and access controls.

Experience managing complex production incidents, root cause analysis, problem records, changes, releases, and operational documentation.

Experience working with distributed teams and supporting business-critical services under agreed SLAs.

Willingness to participate in 24/7 support rotations or cover critical business hours when required.

Technologies and Tools

Must have

MLOps: experiment tracking, model packaging, model registry, evaluation gates, approval workflows, deployment strategies, feature and data dependencies, monitoring, rollback, and lifecycle management.

LLMOps: foundation model endpoints, prompt and model configuration, evaluation, retrieval-augmented generation, embeddings, vector retrieval, guardrails, observability, token and cost management, and production support.

Model serving and API operations: REST APIs, streaming, endpoint security, authentication, rate limits, quotas, retries, timeouts, autoscaling, load balancing, latency, and availability.

Observability: logs, metrics, traces, dashboards, alerting, service-level indicators, model-quality measures, drift detection, safety monitoring, token usage, and cost reporting.

Python for automation, API integrations, troubleshooting, evaluation tooling, health checks, and operational utilities.

Git and CI/CD for model, prompt, configuration, pipeline, and infrastructure deployment across controlled environments.

Production operations covering incident, problem, change, release, availability, capacity, continuity, security, and service-level management.

Good to have

Hands-on exposure to OpenAI APIs, Azure OpenAI, AWS Bedrock, Amazon SageMaker, Microsoft Foundry, Databricks Mosaic AI, MLflow, or equivalent enterprise AI platforms.

Experience with orchestration and agent frameworks such as LangChain, LangGraph, Semantic Kernel, or equivalent technologies, including tool calling and multi-step workflows.

Knowledge of Kubernetes, Docker, serverless platforms, API gateways, service mesh, event-driven architectures, and infrastructure as code such as Terraform or AWS CloudFormation.

Experience with monitoring and observability platforms such as Amazon CloudWatch, Azure Monitor, Application Insights, Prometheus, Grafana, OpenTelemetry, or comparable tools.

Understanding of responsible AI and AI security, including privacy, human oversight, prompt injection resistance, data leakage prevention, content safety, red teaming, evaluation, traceability, and auditability.

Knowledge of vector databases, retrieval systems, model gateways, caching, feature stores, data quality, and model risk management.

Relevant certifications in AWS Machine Learning, AWS AI Practitioner, Azure AI Engineer, Azure AI Fundamentals, MLOps, Kubernetes, DevOps, or cloud architecture.

What we look for

Senior operations engineers who combine strong MLOps and LLMOps knowledge with disciplined production support and end-to-end ownership.

Problem solvers who can analyze models, prompts, APIs, pipelines, cloud se

Apply on company site

Meet Ori - your career agent on WhatsApp

Find jobs, get your roadmap, check if you're ready for a role and prepare applications - in chat, any language.

Ask Ori about this role
Checking your fit…

Opportunity details

Deadline
Closing in 7d · 28 Nov

As stated by the source. Anything not shown was not stated.

EY

Professional Services

EY is building a better working world by creating new value for clients, people, society, the planet, while building trust in the capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams in more than 150 countries work across a full spectrum of services in assurance, consulting, tax, strategy and transactions, strengthened by sector experience and diverse ecosystem partners. Find out more about the EY global network: http://ey.com/en_gl/legal-statement

Company pageWebsite

More at EY

EYPreferredFunded

On-site · Ha Noi, VN

Senior · 3+ yrs · 10h ago

Senior Associate - Government & Public Sector, Economics & Infrastructure Advisory | Hanoi Office
View role
EYPreferredFunded

On-site · Bengaluru, KA, IN, 560016

Senior · 8+ yrs · 10h ago

Agile-EY - GDS Consulting - AI And DATA - Data Modeller -Senior
View role
EYPreferredFunded

On-site · Chennai, TN, IN, 600032

Senior · 4+ yrs · 10h ago

Agile-DE - Cloud - Senior Data Platform Engineer - GDSN02
View role
EYPreferredFunded

On-site · Bengaluru, KA, IN, 560016

Senior · 5+ yrs · 10h ago

DE-RCE-Risk Java Full stack Sr-GDSN02
View role
Apply