Tailored answers, filled into supported job forms.Your tailored resume and answers, filled into supported job forms for you to review.

Download the Chrome Extension
AI AdoptionJob SimulationCertificationsRoadmapsPricing
Sign In
OneRoadmap

OneRoadmap is a career platform built around ORI, its AI career agent. ORI finds overlooked job opportunities, matches them to your profile and shows the skill gaps to close, with roadmaps, challenges, job simulations and certifications to close them. When you are ready, it prepares a tailored resume, application answers and an application strategy, with a cover letter where the application asks for one. The OneRoadmap Chrome extension fills supported application forms for you to review and submit, and you keep track of every application in one place.

gaurav.ghai@oneroadmap.io
Delhi NCR, India

Platform

  • AI Roadmaps
  • Free Certifications
  • Learning Resources
  • Pricing

Training

  • AI Adoption Workshops
  • Expert Sessions
  • Upcoming Events
  • Workshop Gallery

Company

  • About
  • Blog
  • Contact

Legal

  • Privacy
  • Terms
  • Refunds
  • Delete your data

© 2026 OneRoadmap

Operated by Ghai Technologies, India · International operations through One Roadmap Marketing Management, Dubai, UAE

Built for your next chapter.

Open roles

Senior Program Manager, Tech

Uber

Senior · 5+ yrsOn-site · Sunnyvale, CA, United States / San Francisco, CA, United StatesListed 2d ago
Apply now

Backed by

VC portfolio

HQ

🇺🇸 Montevideo, Uruguay

Open roles

826

How to stand out for Senior Program Manager, Tech at Uber

Auto Match agent

Let ORI find you the best jobs.

Set up your Auto Match agent once - your target role, level and where you want to work. It searches every day, scores each opening against your profile and resume, and delivers the ones worth applying to, with a prepared application a click away.

Searches every day Scored against your profile Applications prepared for you
Sign in & set up Auto Match agent

Resume & career call

Get your resume reviewed for this role - 30-minute 1:1 call

Line-by-line resume feedback for this application, how to position your Role Readiness, and a clear plan for what to do next - with a OneRoadmap career coach.

Experience Senior · 6+ yrs (5+ years)

About the role

from listing

About the Role

Uber is looking for a Senior Program Manager, Tech (L5) to lead LLM quality and evaluation programs across multilingual products and AI-powered experiences. You will define how we measure model quality, identify failures, and determine whether AI solutions are ready for production.

Working across Engineering, LLMOps within the Localization Technology team, Multilingual Program manager, Product, and vendors, you will build, assess or improve the existing evaluation frameworks that validate model performance by language, market, content type, cultural nuance, and audiences. This role requires strong technical fluency in LLM behavior, understanding NLP, and the program leadership to turn evaluation findings into measurable improvements.

What You’ll Do

Own the LLM quality and evaluation roadmap. Define program goals, milestones, dependencies, success metrics, and release criteria across models and use cases.

Build scalable evaluation frameworks. Establish statistically defensible methods to assess accuracy such as recall and precision, relevance, completeness, instruction following, linguistic quality, and cultural appropriateness.

Develop high-quality evaluation datasets. Lead the creation, annotation, adjudication, versioning, and maintenance of golden datasets that represent real user needs, challenging scenarios, and multilingual requirements.

Evaluate model and system failures. Partner with technical teams to assess hallucinations, prompt-injection susceptibility, unsupported claims, context loss, and inconsistent outputs. Evaluate retrieval-augmented generation (RAG) for retrieval relevance, groundedness, and citation accuracy.

Lead human and automated evaluation. Establish reviewer guidelines, calibrate LLM-as-a-judge systems against expert assessments, and measure agreement, false positives, false negatives, and severity classification.

Drive model fitness decisions. Collaborating with LLMOpn in the Localization Technology team to compare models and configurations by locale, task, quality, cost, and latency to inform model selection, routing, and deployment.

Close the quality improvement loop. Translate findings into prioritized improvements to prompts, retrieval, terminology, workflows, and model configurations. Partner with owners to verify fixes and prevent regressions.

Operationalize continuous quality monitoring. Establish regression testing, production sampling, quality dashboards, escalation processes, and ongoing evaluation as models and user needs evolve.

Lead cross-functional execution. Clarify ownership, resolve dependencies, communicate risks, and align stakeholders on quality tradeoffs and launch readiness.

Basic Qualifications

Minimum 5 years of professional experience in program management within a high-growth technology or large-scale enterprise environment.

Bachelor’s degree in Business Operations, Engineering, or a related field; or equivalent professional experience.

Preferred Qualifications

8+ years of professional experience in program management within a high-growth technology or large-scale enterprise environment.

Experience leading complex technical programs involving AI/ML, software platforms, quality engineering, or data-driven products.

Demonstrated ability to deliver cross-functional programs with Engineering, Localization team, Data Scientist, Product, and Operations.

Working understanding of LLM capabilities and limitations, including hallucinations, prompt engineering, prompt injection, RAG, context management, and tool use.

Experience designing quality metrics, evaluation methodologies, human-review workflows, or experimental programs.

Ability to interpret statistical results, assess dataset quality, and communicate the limitations of evaluation findings to leaderships and LLMOps.

Strong analytical, stakeholder management, and written communication skills, with the ability to turn ambiguous requirements into executable plans.

Experience evaluating multilingual LLMs, machine translation, conversational AI, or localization quality.

Familiarity with MQM-based evaluation, terminology governance, and market-specific linguistic requirements.

Experience with LLM evaluation platforms, automated regression pipelines, and production observability.

Familiarity with SQL, Python, APIs, and data pipelines sufficient to investigate results and collaborate effectively with technical teams.

Experience evaluating multimodal systems, including text, image, audio, or video.

Experience establishing quality standards and launch criteria for AI systems operating at scale.

For Sunnyvale/San Francisco, CA-based roles: The base salary range for this role is USD $167,000 per year - USD $185,000 per year.

You will be eligible to participate in Uber's bonus program, and may be offered an equity award & other types of comp. All full-time employees are eligible to participate in a 401(k) plan. You will also be eligible for various benefits.

Apply on company site

Meet Ori - your career agent on WhatsApp

Find jobs, get your roadmap, check if you're ready for a role and prepare applications - in chat, any language.

Ask Ori about this role
Checking your fit…
Uber

Internet Marketplace Platforms

We are Uber. The go-getters. The kind of people who are relentless about our mission to help people go anywhere and get anything and earn their way. Movement is what we power. It’s our lifeblood. It runs through our veins. It’s what gets us out of bed each morning. It pushes us to constantly reimagine how we can move better. For you. For all the places you want to go. For all the things you want to get.

For all the ways you want to earn. Across the entire world. In real time. At the incredible speed of now. The idea for Uber was born on a snowy night in Paris in 2008, and ever since then our D

Company pageWebsite

More at Uber

UberPreferredFunded

On-site · San Francisco, CA, United States / New York City, NY, United States

3+ yrs · 2d ago

Machine Learning Engineer II
View role
UberPreferredFunded

On-site · San Francisco, CA, United States / New York City, NY, United States

Senior · 2d ago

Lead Product Manager, AV Labs
View role
UberPreferredFunded

On-site · Bengaluru, Karnataka, India

Senior · 6+ yrs · 2d ago

Sr Software Engineer - ios
View role
UberPreferredFunded

On-site · Sunnyvale, CA, United States / San Francisco, CA, United States / Seattle, WA, United States

Senior · 5+ yrs · 2d ago

Senior Machine Learning Engineer
View role
Apply