Tailored answers, filled into supported job forms.Your tailored resume and answers, filled into supported job forms for you to review.

Download the Chrome Extension
AI AdoptionJob SimulationCertificationsRoadmapsPricing
Sign In
OneRoadmap

OneRoadmap is a career platform built around ORI, its AI career agent. ORI finds overlooked job opportunities, matches them to your profile and shows the skill gaps to close, with roadmaps, challenges, job simulations and certifications to close them. When you are ready, it prepares a tailored resume, application answers and an application strategy, with a cover letter where the application asks for one. The OneRoadmap Chrome extension fills supported application forms for you to review and submit, and you keep track of every application in one place.

gaurav.ghai@oneroadmap.io
Delhi NCR, India

Platform

  • AI Roadmaps
  • Free Certifications
  • Learning Resources
  • Pricing

Training

  • AI Adoption Workshops
  • Expert Sessions
  • Upcoming Events
  • Workshop Gallery

Company

  • About
  • Blog
  • Contact

Legal

  • Privacy
  • Terms
  • Refunds
  • Delete your data

© 2026 OneRoadmap

Operated by Ghai Technologies, India · International operations through One Roadmap Marketing Management, Dubai, UAE

Built for your next chapter.

Open roles

AI / ML · Software Engineering

Sr Director of Software Engineering- AI Infrastructure Platforms

JPMorgan Chase

Senior · 15+ yrsOn-site · Seattle, WA, United States / Palo Alto, CA, United States / San Francisco, CA, United StatesListed 3d ago
Apply now

Backed by

VC portfolio

HQ

🇺🇸 New York City, NY, United States

Open roles

8057

How to stand out for Sr Director of Software Engineering- AI Infrastructure Platforms at JPMorgan Chase

Auto Match agent

Let ORI find you the best jobs.

Set up your Auto Match agent once - your target role, level and where you want to work. It searches every day, scores each opening against your profile and resume, and delivers the ones worth applying to, with a prepared application a click away.

Searches every day Scored against your profile Applications prepared for you
Sign in & set up Auto Match agent

Resume & career call

Get your resume reviewed for this role - 30-minute 1:1 call

Line-by-line resume feedback for this application, how to position your Role Readiness, and a clear plan for what to do next - with a OneRoadmap career coach.

Experience Senior · 6+ yrs (15+ years)

About the role

from listing

Direct multiple technical areas, manage the activities of multiple departments, and collaborate across technical domains

Your opportunity to make a real impact and shape the future of financial services is waiting for you. Let’s push the boundaries of what's possible together.

As a Senior Director of Software Engineering at JPMorganChase within the firmwide AI Infrastructure Platform organization, you will lead multiple technical areas and manage the activities of multiple departments responsible for delivering a unified AI infrastructure layer across on ‑ premises environments, public cloud, and emerging accelerated ‑ compute vendors. You will collaborate across AI/ML engineering, infrastructure, security and controls, and vendor teams to ensure the firm remains at the forefront of AI platform capabilities, operational excellence, and industry best practices.

In this role, you will own training and experimentation on a Kubernetes ‑ standardized platform. While a dedicated architecture function exists, you will act as an active design partner—guiding architectural trade ‑ offs and ensuring designs translate into reliable, secure, and operable systems at enterprise scale.

Job responsibilities

Lead multiple technology and platform implementations across departments to deliver firmwide AI infrastructure objectives, with a primary focus on training and experimentation platforms operating at enterprise scale.

Own the design, delivery, and evolution of a Kubernetes ‑ first AI Infrastructure platform , including Kubernetes ‑ native support for batch and distributed training & Inference jobs, lifecycle management, retry semantics, and failure recovery patterns.

Standardize AI developer workflows for experimentation, enabling self ‑ service job submission, reusable templates and golden paths, reproducibility mechanisms, and consistent runtime behavior across hybrid deployment environments.

Build and evolve platform APIs and automation, including Kubernetes controllers and operators where appropriate, to ensure the platform is safe, scalable, and easy to adopt across teams.

Drive measurable improvements in GPU availability and utilization through reliability engineering, fleet readiness patterns, and accelerated capacity onboarding.

Define and implement governance ‑ based scheduling and placement strategies, including:   Multitenant GPU quotas and guardrails, Priority, admission control, and reservation patterns, Preemption policies, Fragmentation reduction and topology ‑ aware placement (GPU type, MIG, and topology awareness)

Embed enterprise ‑ grade security, risk, and control requirements into platform defaults, including IAM and RBAC controls, secrets management, audit logging, policy enforcement, network segmentation, and controlled change management.

Drive operational excellence by establishing SLIs and SLOs, managing error budgets, leading incident management practices, forecasting capacity, and delivering end ‑ to ‑ end platform observability across job lifecycles and GPU telemetry.

Act as the primary interface with senior leaders, stakeholders, and executives, driving alignment and consensus across competing priorities and complex initiatives.

Lead multiple engineering teams and managers, building a high ‑ performing organization with strong engineering standards, scalable operating models, and a culture of accountability and continuous improvement.

Champion the firm’s culture of diversity, opportunity, inclusion, and respect.

Required qualifications, capabilities, and skills

15+ years of engineering experience, including 8+ years of senior engineering leadership experience with responsibility for managing managers.

Demonstrated experience delivering platform products (beyond foundational infrastructure) with strong adoption, reliability, and operational maturity.

Experience developing and leading large, cross ‑ functional engineering teams within highly matrixed and complex enterprise environments.

Proven track record of leading complex initiatives supporting distributed system design, testing, and operational stability at scale.

Deep hands ‑ on expertise with Kubernetes ‑ based platforms , including:  Multi ‑ tenancy , RBAC, admission control, and network policy,  Multi ‑ cluster operations, upgrades, and cluster lifecycle management,  Controllers, operators (CRDs), and platform API design patterns

Experience supporting AI training and experimentation platforms, including:  PyTorch and distributed training concepts such as scaling, orchestration, and failure modes,  Ray or similar frameworks for distributed experimentation execution,

Familiarity with Slurm or equivalent HPC or batch schedulers and core concepts such as queues, fair ‑ share , reservations, and preemption

Understanding of modern AI inference stacks (for example, vLLM ) and how serving constraints—latency, throughput, batching, KV cache behavior, and GPU memory limits—influence training and experimentation platform design.

Strong understanding of GPU infrastructure fundamentals, including NVIDIA ecosystem capabilities, health and telemetry signals, and scheduling and placement constraints.

Extensive practical experience with cloud ‑ native technologies and hybrid infrastructure environments spanning on ‑ premises and public cloud.

Experience hiring, developing, coaching, and retaining high ‑ performing engineering talent.

Preferred qualifications, capabilities, and skills

Experience operating large ‑ scale GPU fleets, including heterogeneous accelerator environments.

Experience delivering hybrid AI platforms across on ‑ premises infrastructure, public cloud, and specialized accelerated ‑ compute vendors.

Experience working at the code level within large ‑ scale distributed systems.

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorganChase’s review of criminal conviction history, including pretrial diversions or program entries.

TechnologySoftware Engineering
Apply on company site

Meet Ori - your career agent on WhatsApp

Find jobs, get your roadmap, check if you're ready for a role and prepare applications - in chat, any language.

Ask Ori about this role
Checking your fit…
JPMorgan Chase

Financial Services

With a history tracing its roots to 1799 in New York City, JPMorganChase is one of the world's oldest, largest, and best-known financial institutions—carrying forth the innovative spirit of our heritage firms in global operations across 100 markets. We serve millions of customers and many of the world’s most prominent corporate, institutional, and government clients daily, managing assets and investments, offering business advice and strategies, and providing innovative banking solutions and services. Social Media Terms and Conditions: https://bit.ly/JPMCSocialTerms JPMorgan Chase & Co. is an

Company pageWebsite

More at JPMorgan Chase

JPMorgan ChaseSoftware EngineeringPreferredFunded

On-site · Bengaluru, Karnataka, India

Senior · 3+ yrs · 22h ago

Software Engineer III - Java Developer + AWS + Spark + Databricks
View role
JPMorgan ChasePredictive SciencePreferredFunded

On-site · LONDON, LONDON, United Kingdom

Senior · 5+ yrs · 1d ago

Applied AI & ML Lead – Markets Operations
View role
JPMorgan ChasePredictive SciencePreferredFunded

On-site · LONDON, United Kingdom

Senior · 5+ yrs · 1d ago

Applied AI Engineering Lead - VP, Markets Operations
View role
JPMorgan ChaseSoftware EngineeringPreferredFunded

On-site · Columbus, OH, United States

Senior · 5+ yrs · 2d ago

Lead Software Engineer
JavaJEESpring+5 more
View role
Apply