Job Description
We are looking for a Senior Data Engineer / Technical Lead with 8+ years of hands-on data engineering experience , including technical leadership across production data platforms. The ideal candidate should have strong expertise in AWS, Databricks, Spark, Python/Java, SQL, dbt and Airflow , along with experience in data governance, security, real-time processing and enterprise-scale data platforms. Key Responsibilities Design, build and operate production-grade data pipelines . Provide technical leadership across data engineering initiatives. Design solutions and clearly explain technical decisions, trade-offs and rationale. Own the complete data engineering lifecycle: Architecture & Design Development Testing Security Governance Deployment Production Support Build and operate batch and real-time/streaming data pipelines . Work with large-scale data environments involving tens to hundreds of TBs . Implement data quality, validation and reliability frameworks. Manage Databricks governance and access management .
Ensure data security and compliance across production platforms. Conduct technical design reviews and establish engineering standards. Provide delivery assurance and support projects moving at pace. Work closely with Business Analysts, Architects, Data Scientists and End Users . Contribute to effort estimation and commercial discussions. Ensure proposed solutions are technically feasible and deliverable. Mentor engineers through coaching, feedback and structured development. Support production troubleshooting, monitoring and performance optimization. Required Technical Skills 8+ years of hands-on data engineering experience. Strong technical leadership experience on production platforms. Strong hands-on programming skills in: Python Java or similar programming languages Robust SQL skills. AWS Databricks Apache Spark Modern data architecture dbt for data transformations Airflow or equivalent orchestration tools Batch and streaming data pipeline