Tailored answers, filled into supported job forms.Your tailored resume and answers, filled into supported job forms for you to review.

Download the Chrome Extension
AI AdoptionJob SimulationCertificationsRoadmapsPricing
Sign In
OneRoadmap

OneRoadmap is a career platform built around ORI, its AI career agent. ORI finds overlooked job opportunities, matches them to your profile and shows the skill gaps to close, with roadmaps, challenges, job simulations and certifications to close them. When you are ready, it prepares a tailored resume, application answers and an application strategy, with a cover letter where the application asks for one. The OneRoadmap Chrome extension fills supported application forms for you to review and submit, and you keep track of every application in one place.

gaurav.ghai@oneroadmap.io
Delhi NCR, India

Platform

  • AI Roadmaps
  • Free Certifications
  • Learning Resources
  • Pricing

Training

  • AI Adoption Workshops
  • Expert Sessions
  • Upcoming Events
  • Workshop Gallery

Company

  • About
  • Blog
  • Contact

Legal

  • Privacy
  • Terms
  • Refunds
  • Delete your data

© 2026 OneRoadmap

Operated by Ghai Technologies, India · International operations through One Roadmap Marketing Management, Dubai, UAE

Built for your next chapter.

Open roles

SOFTWARE · Platform

Staff / Principal Software Engineer, Inference Platform - USA

Inworld AI

Senior · 8+ yrsRemote · USFullTimeListed 8mo ago
Apply now

Backed by

Lightspeed India

HQ

🇮🇳 India

Open roles

17

How to stand out for Staff / Principal Software Engineer, Inference Platform - USA at Inworld AI

Auto Match agent

Let ORI find you the best jobs.

Set up your Auto Match agent once - your target role, level and where you want to work. It searches every day, scores each opening against your profile and resume, and delivers the ones worth applying to, with a prepared application a click away.

Searches every day Scored against your profile Applications prepared for you
Sign in & set up Auto Match agent

Resume & career call

Get your resume reviewed for this role - 30-minute 1:1 call

Line-by-line resume feedback for this application, how to position your Role Readiness, and a clear plan for what to do next - with a OneRoadmap career coach.

Experience Senior · 6+ yrs (8+ years)

About the role

structured by ORI

About Inworld Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.

What you will do

  • Work closely with engineers to design, deploy, and maintain reliable, high-performance, and secure cloud infrastructure for our TTS https://inworld.ai/tts and LLM Router https://inworld.ai/router.
  • Drive engineering velocity by identifying and building AI-powered tooling and workflows that improve how our teams develop and deploy software.
  • Facilitate a "you build it, you run it" culture by providing the necessary tools and processes for monitoring the reliability, availability, and performance of services.
  • Manage pipelines to ensure smooth and efficient code integration and deployment.
  • Conduct root cause analysis to identify critical issues and develop automated solutions to prevent recurrence.

What they are looking for

  • 8-10 years of experience in software engineering.
  • 3+ years of experience with infrastructure-as-code.
  • Proficiency in managing Kubernetes clusters and applications, including creating Kustomize manifests/Helm charts for new applications.
  • Experience in creating and maintaining CI/CD pipelines for both applications and infrastructure deployments (using tools like Terraform/Terragrunt, ArgoCD, GitHub Actions, Ansible, etc.).
  • Deep knowledge of at least one major cloud provider (Google Cloud Platform, Microsoft Azure, Oracle Cloud).
  • Proficient in at least one backend programming/scripting languages such as Golang, Python, and Bash.
  • Candidates must be based in the SF Bay Area or willing to relocate (you will be working on-site in our South Bay office a few days a week).

Before you apply

  • Candidates must be based in the SF Bay Area or willing to relocate (you will be working on-site in our South Bay office a few days a week).

Benefits

  • Equity
Software EngineeringInfrastructure-as-codeKubernetesCI/CD pipelinesGolangPythonBashTerraformTerragruntArgoCDGitHub ActionsAnsibleKustomizeHelmGoogle Cloud Platform
Full posting text

About Inworld

Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.

Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production.

We’ve raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Inworld has also been recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn’s Top 10 Startups in the USA.

ABOUT THE ROLE

Inworld Inference https://inworld.ai/inference serves the models consumer apps run on. We're growing it from an API into a full platform: one place where a team can go from its first API call to its own model, tuned on its own traffic and running on capacity reserved for it.

As a Staff or Principal Software Engineer, you'll design that platform's core architecture and write much of its code. You'll define the abstractions every customer workload runs on, and own the system in production at tens of trillions of tokens a month.

WHY THIS ROLE

  • A platform, not a feature. You'll shape the foundation that every future Inference product builds on. The architecture decisions are yours to make.
  • Real scale from day one. Realtime inference for hundreds of millions of end users, with latency budgets measured in milliseconds.
  • Hard problems. Scheduling scarce GPUs across many tenants and workloads, model lifecycles from weights to serving, and latency and uptime commitments customers pay for.
  • Principal-level scope. You'll partner directly with research, product and leadership on where the platform goes next.

WHAT YOU'LL DO

  • Design and build the platform's core services: control plane, model and deployment lifecycle APIs, tenant isolation, metering and quotas.
  • Own how GPU capacity is allocated and scheduled across shared and reserved workloads, with clear latency, cost and reliability trade-offs.
  • Build the path that takes a customer's model from weights to production serving, and keeps it healthy as it changes.
  • Write production code, mostly in Go, every week. You ship services; you don't just configure them.
  • Define the APIs and abstractions that customers and internal teams build on. Make the right path the easy path.
  • Lead design reviews and write the technical direction for the platform. Raise the bar for system design across engineering.
  • Run what you build: set SLOs, take part in incidents, and turn postmortems into design changes.

WHAT WE'RE LOOKING FOR

  • 8+ years building backend or distributed systems in Go, Rust, Java or C++.
  • You've designed and shipped a multi-service system end to end, and can explain its trade-offs and what broke in production.
  • Deep understanding of distributed systems: consistency, failure modes, queuing, load balancing and capacity modelling.
  • Experience building a platform or developer product with external customers: cloud compute, PaaS, serverless, or an API platform.
  • Clear technical writing. You can turn an ambiguous problem into a design doc that others build from.

NICE TO HAVE

  • Schedulers or resource managers for scarce hardware (GPU clusters, batch systems, cloud compute).
  • LLM inference serving (vLLM, SGLang, TensorRT-LLM) or ML training infrastructure.
  • Multi-tenant systems with usage-based billing or contractual SLAs.
  • Comfortable with Kubernetes, Terraform and GitOps (ArgoCD).

IS THIS ROLE FOR YOU?

This is a software engineering role. If most of your recent work is maintaining CI/CD pipelines and infrastructure-as-code, this probably isn't the fit.

Candidates must be based in the SF Bay Area or willing to relocate (you will be working on-site in our South Bay office a few days a week).

The US base salary range for this full-time position is $280,000 - $350,000. In addition to base pay, total compensation includes equity and benefits. Within the range, individual pay is determined by work location, level, and additional factors, including competencies, experience, and business needs. The base pay range is subject to change and may be modified in the future.

Inworld Jobs Privacy https://inworld.ai/jobs-privacy

Apply on company site

Meet Ori - your career agent on WhatsApp

Find jobs, get your roadmap, check if you're ready for a role and prepare applications - in chat, any language.

Ask Ori about this role
Checking your fit…
Inworld AI

India

Backed by Lightspeed India

Company pageWebsite

More at Inworld AI

Inworld AIOperationsFunded

Remote · US

23d ago

AI Trainer (Contractor), Voice and Speech Evaluation - USA
View role
Inworld AIML EngineeringFunded

On-site · Mountain View, California, USA

Senior · 5+ yrs · 28d ago

Senior Machine Learning Engineer, Inference - USA
View role
Inworld AIML EngineeringFunded

Remote · Europe

Senior · 5+ yrs · 7mo ago

Staff / Senior Staff Machine Learning Engineer, Inference - Switzerland
Model AccelerationQuantization+14 more
View role
Inworld AIML EngineeringFunded

Remote · UK

Senior · 5+ yrs · 7mo ago

Staff / Senior Staff Machine Learning Engineer, Inference - UK
Model AccelerationQuantization+14 more
View role
Apply