Experience Senior · 6+ yrs (5+ years)
About the role
structured by ORISenior ML Engineer, LLM SystemsBengaluru · Full-time · mid-senior (3–6 yrs)About EkaCare and the missionEkaCare is India's connected healthcare platform: an EMR that doctors run their practices on, a personal health record used by millions of Indians, and one of the deepest integrations with India's ABDM…
What you will do
- Build corpus pipelines that feed GPUs without stalls: filtering, dedup, PII redaction, tokenisation, streaming dataloaders at ~500B-token scale.
- Run distributed training jobs on multi-node H200 clusters; make failures loud, recoveries fast, dashboards honest.
- Build the eval and experiment tooling researchers live in.
- Wire fast inference paths (vLLM-class) for model iterations.
- Automate whatever annoyed you last week.
What they are looking for
- 3–6 years of strong software engineering with real ML training exposure; you've fine-tuned or trained ≥1B-parameter models, not just called APIs.
- Distributed-computing fundamentals: Slurm or Kubernetes, NCCL basics, storage/throughput intuition.
- Data engineering at scale; Spark, Ray, or whatever gets the job done.
- A bias for ownership: you don't ask whose job it is.
Nice to have
- Triton/CUDA curiosity; profiler literacy.
- Open-source projects or contributions.
- Healthcare or Indic-language data experience.
Benefits
- Medical Insurance & Accidental Insurance
- Maternity & Paternity Benefits
- PF, Gratuity, & Leave Encashment
- Salary Advance Policy
software engineeringML trainingdistributed computingdata engineeringtokenisationGPUsH200vLLMSlurmKubernetesNCCLSparkRay
Full posting text
Experience: 3 - 6