Tailored answers, filled into supported job forms.Your tailored resume and answers, filled into supported job forms for you to review.

Download the Chrome Extension
AI AdoptionJob SimulationCertificationsRoadmapsPricing
Sign In
OneRoadmap

OneRoadmap is a career platform built around ORI, its AI career agent. ORI finds overlooked job opportunities, matches them to your profile and shows the skill gaps to close, with roadmaps, challenges, job simulations and certifications to close them. When you are ready, it prepares a tailored resume, application answers and an application strategy, with a cover letter where the application asks for one. The OneRoadmap Chrome extension fills supported application forms for you to review and submit, and you keep track of every application in one place.

gaurav.ghai@oneroadmap.io
Delhi NCR, India

Platform

  • AI Roadmaps
  • Free Certifications
  • Learning Resources
  • Pricing

Training

  • AI Adoption Workshops
  • Expert Sessions
  • Upcoming Events
  • Workshop Gallery

Company

  • About
  • Blog
  • Contact

Legal

  • Privacy
  • Terms
  • Refunds
  • Delete your data

© 2026 OneRoadmap

Operated by Ghai Technologies, India · International operations through One Roadmap Marketing Management, Dubai, UAE

Built for your next chapter.

Open roles

AI / ML · Infrastructure Engineering

Director of Infrastructure Engineering - AI

JPMorgan Chase

Senior · 10+ yrsOn-site · New York, NY, United States / Columbus, OH, United States / Wilmington, DE, United StatesListed 7d ago
Apply now

Backed by

VC portfolio

HQ

🇺🇸 New York City, NY, United States

Open roles

8204

How to stand out for Director of Infrastructure Engineering - AI at JPMorgan Chase

Auto Match agent

Let ORI find you the best jobs.

Set up your Auto Match agent once - your target role, level and where you want to work. It searches every day, scores each opening against your profile and resume, and delivers the ones worth applying to, with a prepared application a click away.

Searches every day Scored against your profile Applications prepared for you
Sign in & set up Auto Match agent

Resume & career call

Get your resume reviewed for this role - 30-minute 1:1 call

Line-by-line resume feedback for this application, how to position your Role Readiness, and a clear plan for what to do next - with a OneRoadmap career coach.

Experience Senior · 6+ yrs (10+ years)

About the role

from listing

Drive innovation and infrastructure engineering solutions, lead a technical area, and serve as a primary decision maker for your teams

At a world-renowned company like JPMorganChase, you can take the lead in shaping the future of technology, unleashing your full potential, and making your mark on the industry.

As a Director of Infrastructure Engineering at JPMorganChase within the Core Engineering Solutions and Architecture group, you manage one large area or multiple smaller ones with advanced technical knowledge to resolve complex issues. Exercise independent judgement within general guidelines and parameters to determine appropriate actions.

Job responsibilities

Manages technical area(s) within infrastructure engineering, collaborates with others across different technical areas and anticipates the needs of multiple disciplines within the function

Sets the multi-year strategy and roadmap for AI infrastructure across Consumer & Community Banking, aligned to business priorities and the firm's technology direction

Sets reuse-first expectations for enterprise-authorized AI adoption within the work environment across the function to accelerate delivery and improve decision quality, with human-in-the-loop validation and appropriate handling of sensitive data

Manages and implements corporate and divisional operational plans, develops and executes the function objectives, and provides broad direction to teams, team leads, and supervisors with accountability for outcomes, including building, leading, and growing a high-performing organization of engineers and engineering managers through hiring, coaching, performance management, and succession planning

Manages key senior stakeholders and ensures teams deliver in accordance with compliance standards, risk and security, service level agreements, and business requirements, including partnering with business and product leaders to translate AI use cases into infrastructure requirements prioritized against value and risk

Represents the business's needs to firm-wide technology and platform teams, shaping roadmaps, negotiating priorities and timelines, and escalating when commitments slip

Drives multiple large complex projects, processes and initiatives through to delivered outcomes — use cases in production, measurable cost savings, and improved reliability

Responsible for staffing, budget, and relevant profit and loss, including managing and developing budgets

Establishes governance standards for AI-assisted workflows used in delivery and operational routines, ensuring traceability/auditability and alignment to resiliency, security, and risk expectations

Required qualifications, capabilities, and skills

Formal training or certification on infrastructure engineering concepts and 10+ years applied experience

Experience managing cross-functional teams of infrastructure engineers, with a demonstrated track record of setting technical strategy and delivering it against measurable outcomes

Demonstrated experience leading teams in the safe use of enterprise-authorized AI capabilities within the work environment for infrastructure engineering workflows, including validation habits and awareness of data sensitivity

Ability to define review and approval expectations for AI-assisted recommendations and ensure outcomes align to resiliency, security, and auditability expectations

Experience hiring, developing, and recognizing talent, and creating a culture of ownership and engineering excellence

Extensive knowledge of hardware aligned to infrastructure engineering, including deep background in cloud infrastructure, platform, or site reliability engineering with hands-on depth on at least one major cloud provider (AWS: compute, networking, IAM, managed Kubernetes, observability)

Experience turning business needs into technical roadmaps and influencing central or shared technology teams not directly managed, with strong cross-team collaboration across engineering, product, security, risk, and finance

Excellent stakeholder management and executive communication, written and verbal, including presenting to senior leadership, together with budget and vendor management experience and comfort making investment and cost trade-off decisions

Experience running ML or GenAI workloads in production, such as hosted model APIs (Amazon Bedrock, Azure OpenAI, Google Vertex AI or similar) behind API gateways, with authentication, rate limiting, and resilience, as well as building AI skills, plugins, and agents

Experience with Kubernetes, including GPU scheduling and auto-scaling, infrastructure as code with Terraform (or equivalent), and CI/CD for infrastructure

Python and automation fluency to convert manual efforts into automated solutions, paired with observability expertise using tools such as Splunk, Datadog, Prometheus/Grafana, or OpenTelemetry

Preferred qualifications, capabilities, and skills

Experience with GPU compute – orchestration, scheduling, reclaim policies

Model serving and optimization: AI Gateways, vLLM, Triton, TensorRT, batching, quantization, latency and throughput

Distributed training: PyTorch FSDP, DeepSpeed, Megatron-LM; high-speed GPU interconnects (NVLink, InfiniBand)

RAG and vector databases (OpenSearch, pgvector, Pinecone or similar); agent frameworks (LangChain, LlamaIndex or similar)

GPU capacity planning and FinOps for AI workloads: cost allocation, chargeback, reserved capacity

Experience leading an LLM gateway, AI platform, or ML platform organization

Leadership experience in the financial services industry, including working with risk, compliance, and audit teams

TechnologyInfrastructure Engineering
Apply on company site

Meet Ori - your career agent on WhatsApp

Find jobs, get your roadmap, check if you're ready for a role and prepare applications - in chat, any language.

Ask Ori about this role
Checking your fit…
JPMorgan Chase

Financial Services

With a history tracing its roots to 1799 in New York City, JPMorganChase is one of the world's oldest, largest, and best-known financial institutions—carrying forth the innovative spirit of our heritage firms in global operations across 100 markets. We serve millions of customers and many of the world’s most prominent corporate, institutional, and government clients daily, managing assets and investments, offering business advice and strategies, and providing innovative banking solutions and services. Social Media Terms and Conditions: https://bit.ly/JPMCSocialTerms JPMorgan Chase & Co. is an

Company pageWebsite

More at JPMorgan Chase

JPMorgan ChaseTechnologyPreferredFunded

On-site · Ciudad Autónoma de Buenos Aires, Argentina

Senior · 4h ago

Lead Infrastructure Engineer
View role
JPMorgan ChaseAnalystsPreferredFunded

On-site · Mumbai, Maharashtra, India

Fresher · 23h ago

Wholesale Credit Risk Analyst
View role
JPMorgan ChaseQuant AnalyticsPreferredFunded

On-site · Plano, TX, United States / Wilmington, DE, United States

Senior · 5+ yrs · 23h ago

Vice President, Quantitative Analytics Manager – Digital Analytics
View role
JPMorgan ChaseSoftware EngineeringPreferredFunded

On-site · Tampa, FL, United States

Senior · 3+ yrs · 23h ago

Java Backend Software Engineer III
View role
Apply