Job description
Lead Data Product Engineer 1. Role overview The Lead Data Product Engineer will provide technical direction, hands-on engineering leadership, and stakeholder leadership for the project. The role combines the responsibilities of a Technical Lead and Data Architect with active, hands-on data engineering. The Lead will guide the engineering delivery team in line with technical standards. The Lead will use deep technical knowledge to guide delivery teams, challenge assumptions, assess design quality, manage dependencies, identify risks, and support informed decision-making. They must be able to explain processes, issues, and Root Cause Analyses (RCAs) to stakeholders from a business-outcome and KPI perspective, not only from a platform or engineering perspective. Role type: Lead role leading the engineering delivery. This is not a line-management role.

Experience:
8-10 years as a Lead Data Product Engineer in the Life Sciences / Pharma Commercial domain. Expected balance of the role: The Lead Data Product Engineer is expected to perform all three of the following areas and must demonstrate a strong balance across them: Technical leadership and hands-on engineering: design, build, review, and optimise data products and pipelines, and lead engineering delivery. Stakeholder management: act as the primary point of contact and engage confidently with business stakeholders at a KPI and business-outcome level. Governance, documentation, and transition support: provide oversight to ensure the solution is documented, governed, and supportable. 2. Technology and domain context Platform and tooling: Orchestration: Apache Airflow Cloud: AWS Data platforms: Databricks and Snowflake Source control: Bitbucket Reporting: Power BI (primary visualisation layer) Architecture: Medallion Architecture (bronze, silver, gold) is already implemented. The Lead is responsible for owning, maintaining, enhancing, and, where required, redesigning it. Business domain: Claims data and commercial performance data, including PP and NPP KPIs and their business context Field team data, and how commercial stakeholders use it for reporting 3.

Key responsibilities
Technical leadership and engineering delivery Provide technical leadership and direction across the project and lead engineering delivery in line with AZ technical standards. Hands-on design, development, and optimisation of data pipelines and data products on Airflow, Databricks, and Snowflake. Own the Medallion Architecture, ensuring the purpose and boundaries of each layer are explicit and consistently applied. Review and challenge proposed architecture, data flows, integration approaches, data models, and reporting solutions. Design and manage Airflow workflows, including orchestration, scheduling, dependencies, refresh mechanisms, and operational management of pipelines. Define and apply data partitioning strategies to improve scalability and performance. Review delivery plans and technical designs to confirm that data movement from source systems to reporting layers is feasible and appropriately controlled. Data modelling, business rules, and reporting Review proposed data models using knowledge of facts, dimensions, data grain,



relationships, KPIs, and aggregation logic. Confirm that business rules and metric definitions (including PP and NPP KPIs) are clearly understood, consistently applied, and traceable to agreed requirements. Review data lineage, dependencies, ownership, and downstream consumption of Gold-layer datasets in Power BI. Assess the impact of changes to source systems, pipelines, transformation logic, Gold-layer datasets, semantic models, and reports. Issue investigation and RCA Coordinate the investigation of data discrepancies, refresh failures, performance issues, and delivery concerns. Create RCA documents for issues identified across source, transformation, and reporting layers. Ensure technical issues are assigned to the correct owners and progressed to resolution. Stakeholder management Act as the primary point of contact for project stakeholders and the business. Build effective relationships with business representatives, commercial and field stakeholders, product owners, delivery leads, data engineers, architects, Power BI teams, suppliers, and support teams. Translate technical considerations into clear impacts, risks, options, and recommendations. Communicate complex topics clearly to audiences with varying levels of technical knowledge. Manage expectations by explaining what is known, what remains uncertain, and what decisions are required. Identify technical risks, cross-team dependencies, assumptions, and delivery blockers early. Governance and transition to business-as-usual (BAU) Assess whether the solution is technically and operationally ready for transition into BAU support. Maintain full knowledge of the required transition artefacts: architecture diagrams, data lineage, runbooks, monitoring, SLAs, support models, ownership, and data quality rules. Identify readiness gaps and agree remediation plans with delivery and operational stakeholders. Provide a clear recommendation: ready for transition, ready with agreed risks, or not ready for sign-off. 4. Required knowledge and skills Data architecture and engineering Medallion Architecture (bronze, silver, gold) and the implications of each layer Data lineage, source-to-target dependencies, ownership, and downstream consumption ETL and ELT patterns, ingestion, transformation, orchestration, scheduling, and refresh mechanisms Apache Airflow: workflow design, orchestration, and operational management Databricks: architecture, engineering practices, and hands-on implementation Snowflake: architecture, platform capabilities, and data engineering best practices Data partitioning strategies for scalability and performance optimisation Common pipeline failure points, data quality issues, integration risks,



and operational dependencies End-to-end data flow from source systems through transformation layers to reporting and analytics AWS cloud services and Bitbucket-based code management Data modelling and reporting Fact and dimension tables, data grain, relationships, keys, measures, and aggregation logic KPI definitions, business rules, semantic models, and consumption of Gold-layer datasets by Power BI Investigating data discrepancies, refresh failures, and performance issues Producing RCA documentation across source, transformation, and reporting layers Domain knowledge (life sciences / pharma commercial) Claims data and commercial performance data, including PP and NPP KPIs and their business context How field teams operate and how commercial stakeholders use field data for reporting Ability to engage at a business outcome and KPI level Technical leadership and governance Experience reviewing solution documentation, delivery plans, operational models, support arrangements, and transition artefacts Understanding of risks from incomplete documentation, unclear ownership, insufficient monitoring, weak data quality controls, and unsupported dependencies Ability to make balanced recommendations based on technical evidence, business impact, delivery constraints, and operational risk Stakeholder and delivery management Proven experience working with senior stakeholders and multidisciplinary delivery teams Ability to influence outcomes without direct line management responsibility Experience managing expectations, resolving ambiguity, facilitating decisions, and communicating risks Strong written and verbal communication, including presenting technical information to non-technical audiences 5. Desired abilities Fact-based approach and an eager-to-learn mindset Credible technical direction, acting as the businesss point of contact Ability to explain bronze, silver, and gold architecture implications to both technical and business audiences Effective challenge of data engineering, modelling, reporting, and integration proposals Early identification of risks and dependencies before they become delivery or operational issues Clear understanding and assurance of business rules, KPI definitions, data lineage, and ownership Coordination of stakeholders and technical teams to reach timely, well-informed decisions Confidence-building that the solution is supportable, governed, documented, and transition-ready Clear communication of readiness recommendations at each project stage 6. Qualifications and experience summary

Experience:
8-10 years as a Lead Data Product Engineer Industry: Life Sciences / Pharma Commercial domain Core platforms: Airflow, AWS, Databricks, Snowflake, Bitbucket Reporting: Power BI Architecture: Medallion Architecture (existing; ownership and evolution required) Role type: Lead engineering delivery, hands-on, no line management Role balance: Strong balance across technical leadership and hands-on engineering, stakeholder management, and governance and transition support Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 LEAD DATA PRODUCT ENGINEER (Chennai)
🏢 TESTQ Technologies
📍 Chennai