Corporate Sector - Lead Data Engineer

Build secure, scalable data pipelines and platforms for collection, access and analytics.

Join a team that builds secure, scalable data pipelines and platforms for collection, access and analytics.

As a Lead data Engineer, within the Corporate Sector you will lead architecture and engineering for scalable backup, recovery, immutable-data protection, and recovery-assurance services across data platforms and storage tiers and deliver data collection, storage, access, and analytics platform solutions in a secure, stable, scalable way, with clear SLOs/SLAs and operational readiness gates.

Job Responsibilities

Observability (Dashboards: Grafana, Dynatrace, Tableau)

Design, build, and maintain role-based observability dashboards for data platforms and backup/recovery services using Grafana, Dynatrace, and Tableau , providing real-time and historical visibility into platform health, performance, and risk posture.

Define and govern dashboard standards and operating model (golden dashboards, drill-down paths, naming/tagging conventions, ownership, and lifecycle management) to drive consistent adoption across Engineering, SRE, Operations, and Risk.

Ensure end-to-end instrumentation and telemetry quality so dashboards surface actionable signals (availability, latency, throughput, error rates, saturation) and platform KPIs (job success/failure, lag/backlog, data freshness, restore success, retention coverage).

Establish and publish SLIs/SLOs and operational health KPIs; translate these into Grafana/Dynatrace visualizations and Tableau reporting for executive and governance stakeholders.

Data Architecture, Modeling, and Governance

Generate and govern data models using firmwide tooling; apply linear algebra, statistical, and geometric algorithms where relevant for modeling and optimization.

Own and continuously improve the strategy for database backup, recovery, archiving, retention, and restore testing across relational and NoSQL estates.

Platform Engineering & Automation

Drive an automation-first, API-led, self-service approach that reduces operational toil and improves resilience and customer experience.

Build cloud-native capabilities using AWS services , infrastructure as code , CI/CD , and modern software engineering practices.

Reliability Engineering (SRE) & Operational Excellence

Embed SRE principles by defining and tracking reliability metrics ( SLIs/SLOs ), implementing observability standards, leading incident learning, and maintaining runbooks and recovery playbooks .

Participate in an on-call and incident leadership rotation , acting as an escalation point for complex platform and data reliability issues.

Security, Controls, and Recovery Assurance

Assess and report on access control effectiveness and data asset security posture ; partner with security/risk to remediate gaps.

Design preventive/detective controls, policy guardrails, automated validation, and audit-ready evidence for platform controls and recovery readiness.

Deliver telemetry, reporting, and operational intelligence for backup health, compliance, and recovery assurance (coverage, success rates, RPO/RTO attainment).

Technical Leadership & Delivery Management

Set engineering standards, perform high-quality code reviews, mentor engineers, and influence stakeholders across product, architecture, security, and SRE.

Coordinate cross-team delivery with explicit dependencies, milestones, and measurable outcomes; manage technical debt and balance reliability/security work alongside feature delivery.

Core Engineering Scope (Hands-on)

Data architecture & modeling (lakehouse/warehouse patterns, dimensional modeling, data contracts)

Advanced SQL (performance tuning, warehousing design)

Pipeline engineering & orchestration (reliable batch workflows, backfills, SLAs)

Distributed processing (e.g., Spark; partitioning, joins/shuffles, file formats)

Data quality & testing (automated checks: schema/freshness/volume/business rules)

Required Qualifications, Capabilities, and Skills

Typically 8+ years of applied engineering experience (software engineering or related discipline), including leading production-critical systems ; experience with both relational and NoSQL databases.

Proficient across the data lifecycle (ingestion, modeling, storage, serving, governance, operations) with demonstrated experience building distributed systems , platform services , APIs , and automation frameworks .

Strong knowledge of enterprise data protection , backup/recovery, cyber resilience, immutable storage, retention, and recovery testing.

Advanced AWS experience spanning backup/data protection services, IAM/security , networking fundamentals, observability, and infrastructure automation.

Hands-on experience with observability/monitoring platforms such as Dynatrace and Grafana .

Proficiency in Python and at least one additional language (e.g., Java, Go, C# ).

Experience with CI/CD platforms (e.g., Jenkins, GitLab, GitHub Actions ) and implementing database backup/recovery/archiving strategies with measurable RPO/RTO targets.

Proficient knowledge of linear algebra , statistical, and geometric algorithms; ability to translate security, control, and regulatory requirements into engineered solutions and operational processes.

Strong capability in: observability & operations (monitoring, lineage, incident response/runbooks), security/privacy/governance (least privilege, encryption concepts, auditability), system design & tradeoff analysis (scalability, latency, reliability, cost), and technical leadership (standards, mentoring, stakeholder alignment).

Preferred Qualifications, Capabilities, and Skills

Experience with Kubernetes/OpenShift and containerized platform operations.

Experience with database platforms and cyber-recovery / isolated recovery solutions.

Experience building operational analytics (health/compliance dashboards, evidence automation) for regulated financial services environments.