Sr Lead Software Engineer - Data Engineering

Drive significant business impact and tackle a diverse array of challenges that span multiple technologies and applications

Embrace this pivotal role as an essential member of a high-performing team dedicated to reaching new heights in data engineering. Your contributions will be instrumental in shaping the future of one of the world's largest and most influential companies.

As a Senior Lead Software Engineer at JPMorganChase within Consumer & Community Banking Risk Technology, you are an integral part of an agile team that designs, builds, and delivers the data utilities and platforms our modeling, analytics, and risk partners depend on. This is a hands-on engineering role — you lead through technical depth, design authority, and the code you write. You will lead a Scrum team building cutting-edge data utilities, setting the technical direction and raising the engineering bar for everyone around you.

Leverage your deep technical expertise and problem-solving capabilities to drive significant business impact and tackle a diverse array of challenges spanning real-time and batch data platforms, multiple data architectures, and a wide range of data consumers.

Job responsibilities

Design, build, and deliver reusable frameworks and platforms that support both high-throughput real-time applications and large-scale batch processing — including Spark workloads over datasets spanning billions of records — in a secure, stable, and scalable way

Write production code daily as the senior technical contributor on the team; lead by example on design quality, testing, and operational readiness

Lead a Scrum team building cutting-edge data utilities, setting technical direction, decomposing complex problems into deliverable work, and unblocking engineers without holding a reporting line

Build and develop the team's technical capability — mentoring engineers, raising code-review standards, growing depth in the platform stack, and creating the conditions for a self-reliant, high-performing team

Provide recommendations and insight on data management and governance procedures applicable to the acquisition, maintenance, validation, and utilization of data — spanning Data Governance, Data Quality, Data Profiling, and Data Lineage

Use the latest enterprise-authorized generative AI and agentic AI capabilities to accelerate design, implementation, testing, and technical documentation — validating outputs and handling data according to sensitivity and security requirements

Design and deliver trusted data collection, storage, access, and analytics platform solutions across AWS, Databricks, and Snowflake

Build streaming and low-latency serving components using Kafka, Cassandra, and related AWS services to support real-time consumption

Partner closely with product, architecture, modeling, and model-deployment teams to understand data requirements and deliver the engineering that feeds and serves them

Apply reuse-first, AI-assisted practices within delivery and operational routines — ensuring traceability, auditability, and alignment to resiliency and security expectations

Present technical designs, platform metrics, and data insights to engineering and business stakeholders through clear visual delivery

Required qualifications, capabilities, and skills

Formal training or certification on software engineering concepts and 5+ years applied experience

Strong hands-on programming expertise in Java, Python, and Scala

Demonstrated experience building frameworks and platforms — not just applications — that other teams adopt and build on

Proven experience delivering both high-throughput real-time systems and high-volume Spark processing over very large datasets, with a working command of performance tuning at scale

Deep hands-on experience with AWS (compute, serverless, managed data services, IAM) and Databricks — including Unity Catalog, Delta Lake, Lakeflow, Delta Live Tables, Catalog Sharing, fine-grained access control, and SQL Warehouses

Hands-on experience with Snowflake in a production data platform environment

Working experience with Kafka, Cassandra, and related AWS streaming and NoSQL offerings

Strong understanding of both relational and NoSQL databases, including data modeling trade-offs between them

Demonstrated experience using enterprise-authorized generative AI capabilities to accelerate engineering delivery, with strong validation habits and awareness of data sensitivity

Experience working on AI/ML systems, with a solid understanding of core model families — decision trees, ensemble methods, and neural networks — and a conceptual understanding of transformer models

Mastery of Agile/Scrum delivery in practice

Preferred qualifications, capabilities, and skills

Experience mentoring and growing engineers and building team technical capability without formal management authority

AWS, Databricks, and/or Snowflake certifications

Strong grasp of Data Governance, Data Quality, Data Profiling, and Data Lineage in regulated environments

Hands-on experience with feature provisioning for ML — including Feature Store on Unity Catalog

Experience adopting agentic AI development tooling on a team and measurably accelerating deliver

Exposure to cloud migration or platform modernization at scale