Tailored answers, filled into supported job forms.Your tailored resume and answers, filled into supported job forms for you to review.

Download the Chrome Extension
AI AdoptionJob SimulationCertificationsRoadmapsPricing
Sign In
OneRoadmap

OneRoadmap is a career platform built around ORI, its AI career agent. ORI finds overlooked job opportunities, matches them to your profile and shows the skill gaps to close, with roadmaps, challenges, job simulations and certifications to close them. When you are ready, it prepares a tailored resume, application answers and an application strategy, with a cover letter where the application asks for one. The OneRoadmap Chrome extension fills supported application forms for you to review and submit, and you keep track of every application in one place.

gaurav.ghai@oneroadmap.io
Delhi NCR, India

Platform

  • AI Roadmaps
  • Free Certifications
  • Learning Resources
  • Pricing

Training

  • AI Adoption Workshops
  • Expert Sessions
  • Upcoming Events
  • Workshop Gallery

Company

  • About
  • Blog
  • Contact

Legal

  • Privacy
  • Terms
  • Refunds
  • Delete your data

© 2026 OneRoadmap

Operated by Ghai Technologies, India · International operations through One Roadmap Marketing Management, Dubai, UAE

Built for your next chapter.

Open roles

AI / ML · Product

AI Inference Framework Engineer

Quadric.io

3+ yrsRemote · WorldwideFullTimeListed 20d ago
Apply now

Backed by

Pear VC

HQ

🇺🇸 US

Open roles

19

How to stand out for AI Inference Framework Engineer at Quadric.io

Auto Match agent

Let ORI find you the best jobs.

Set up your Auto Match agent once - your target role, level and where you want to work. It searches every day, scores each opening against your profile and resume, and delivers the ones worth applying to, with a prepared application a click away.

Searches every day Scored against your profile Applications prepared for you
Sign in & set up Auto Match agent

Resume & career call

Get your resume reviewed for this role - 30-minute 1:1 call

Line-by-line resume feedback for this application, how to position your Role Readiness, and a clear plan for what to do next - with a OneRoadmap career coach.

Experience 3–6 yrs (3+ years)

About the role

from listing

Quadric is redefining edge AI with the industry's first General Purpose Neural Processing Unit (GPNPU), enabling developers to run both neural network inference and conventional C++ code on a single programmable architecture. Our technology powers intelligent edge devices across automotive, industrial, robotics, and embedded systems.

Founded in 2016 and based in downtown Burlingame, California, Quadric is building the world's first supercomputer designed for the real-time needs of edge devices. Quadric aims to empower developers in every industry with superpowers to create tomorrow's technology, today. The company was co-founded by technologists from MIT and Carnegie Mellon, who were previously the technical co-founders of the Bitcoin computing company 21.

THE OPPORTUNITY

Quadric's GPNPU runs both neural networks and C++ code on a single programmable architecture. As a member of our AI Application team, you will make the GPNPU a first-class backend in the frameworks developers already use, such as llama.cpp, PyTorch, and vLLM. That way, customers can move their applications from GPUs to Quadric with minimal changes. You'll own backend integration from memory and dispatch through serving features, working closely with our kernel, runtime and compiler teams.

WHAT YOU'LL DO

Integrate GPNPU backend into AI compute frameworks (llama.cpp, PyTorch, vLLM, Optimum)

  • Implement framework backend interface, memory allocation, compute dispatch, registration and operators/kernels
  • Implement model compute pipelines including prefill, decode, batching, multi-sequence and multi-modal
  • Support important framework serving features including KV-cache management, paged attention, continuous batching, speculative decoding

Optimize framework performance and accuracy for GPNPU backend

  • Reduce host-device dispatch overhead, implement graph capture/replay, integrate efficient kernels, minimize latency
  • Support quantization formats such as GGUF (Q4/Q8), GPTQ/AWQ, int8/fp16
  • Validate accuracy against reference backends (perplexity, task benchmarks) and drive improvements

WHAT SUCCESS LOOKS LIKE

Within your first 6-12 months, you’ll:

  • Bring up a new LLM/VLM family end to end on the GPNPU backend, with accuracy matching the reference
  • Deliver measurable tokens/s or latency gains on a frontier model
  • Ship one serving feature (e.g. paged KV cache) in a production release

WHAT WE'RE LOOKING FOR

REQUIRED

  • 3+ years building or extending ML frameworks or inference runtimes
  • BS/MS in CS/CE or related fields
  • Strong C/C++ and Python
  • Solid understanding of framework internals: tensor memory management, graph scheduling, operator dispatch
  • Solid understanding of AI compute performance analysis and optimization
  • Fluent with AI coding agents (e.g. Claude Code, Cursor), and interested in building agent-driven workflows for backend and model bring-up

Preferred

  • Experience writing an accelerator backend (CUDA, Metal, Vulkan, Hexagon or another NPU) for an open-source framework
  • Contribution to open-source frameworks (PyTorch, llama.cpp, vLLM)
  • Understanding of low level AI compute pipelines, CPU/NPU, DMA
  • Understanding of graph compilers and kernel fusion

WHAT WE OFFER

The base salary range for this position is $160,000 to $195,000. This range reflects the full span of levels and geographies at which Quadric hires for this role. The actual base salary offered will depend on a number of factors, including the specific level of the role, years and depth of relevant experience, technical skills and competencies, the criticality of the role to the business, internal equity, and work location. In addition to base salary, this role is eligible for equity and a discretionary annual performance bonus as applicable to the role and level.

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings; for roles in other locations, benefits vary and are shared during the hiring process. These include:

  • Medical, dental, and vision insurance from day one - Premiums covered at 99% for Employees
  • Company-paid life Insurance
  • Voluntary supplemental life insurance
  • STD + LTD insurance
  • Commuter support including parking or Caltrain reimbursement. Our office is conveniently located within walking distance of the Caltrain station
  • FSA + HSA
  • Equity with the business
  • Paid Parental Leave
  • 401(k) Retirement Plan
  • Flexible PTO
  • Winter holiday shutdown
  • Catered lunch each day in our office
  • Downtown Burlingame office location, close to shops, cafes, and local amenities
  • Collaborative, low-ego culture with significant ownership and impact
  • A work culture focused on innovative disruption

If this role resonates with you, we encourage you to apply even if your experience does not perfectly match every qualification. We value potential, curiosity, and a willingness to learn just as much as direct experience.

EQUAL EMPLOYMENT OPPORTUNITY

Quadric is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, marital status, medical condition, or any other characteristic protected by applicable federal, state, or local law

E-VERIFY AND RIGHT TO WORK NOTICES

Quadric participates in the E-Verify program to confirm employment eligibility for U.S.-based roles. As part of this process, applicants may review the following notices, which explain your rights and our participation in E-Verify. These notices are provided in English and Spanish.

  • E-Verify Participation Notice (English | Spanish) https://www.e-verify.gov/sites/default/files/everify/posters/EVerifyParticipationPoster.pdf
  • Right to Work Notice (English | Spanish) https://www.e-verify.gov/sites/default/files/everify/posters/IER_RightToWorkPoster%20Eng_Es.pdf

No action is required from candidates during the application process. These notices are provided for informational purposes only.

PRIVACY

By submitting an application, you acknowledge that Quadric will collect and process your personal information as part of the hiring process. Please review our Privacy Policy https://quadric.ai/privacy-policyto understand how we handle your data

Apply on company site

Meet Ori - your career agent on WhatsApp

Find jobs, get your roadmap, check if you're ready for a role and prepare applications - in chat, any language.

Ask Ori about this role
Checking your fit…
Quadric.io

Deep Tech

Semiconductor IP for on-device AI inference

Backed by Pear VC

Company pageWebsite

More at Quadric.io

Quadric.ioEngineering SoftwareFunded

Remote · Worldwide

7d ago

Forward Deployed Engineer
View role
Quadric.ioEngineering SoftwareFunded

Remote · US

Senior · 8+ yrs · 17d ago

Staff Deep Learning Compiler Engineer
View role
Quadric.ioEngineering SoftwareFunded

Remote · US

20d ago

Forward Deployed Engineer
View role
Quadric.ioProductFunded

Remote · Worldwide

3+ yrs · 20d ago

AI Inference Optimization Engineer
View role
Apply