We are seeking an experienced and highly motivated Lead Data Architect / Data Engineering Manager with 10+ years of experience in Data Engineering and Cloud Technologies. The ideal candidate will possess strong expertise in Azure Cloud, PySpark, Python, and modern data platforms, with proven experience leading teams and working directly with clients to deliver scalable enterprise data solutions.
Key Responsibilities
Design, develop, and implement scalable data engineering solutions on Azure Cloud.
Lead end-to-end data integration, data migration, and analytics initiatives.
Architect and optimize large-scale data processing pipelines using PySpark and Python.
Engage directly with clients to gather requirements, provide technical guidance, and drive solution delivery.
Lead and mentor a team of data engineers, fostering technical excellence and best practices.
Define data governance, security, and performance optimization strategies.
Drive architectural decisions and establish technical standards for enterprise data platforms.
Work closely with stakeholders, business teams, and project managers to ensure successful project execution.
Provide estimation, planning, and risk management for data engineering projects.
Required Skills & Experience
Experience
12-15 years of overall IT experience.
10+ years of experience in Data Engineering.
Experience leading technical teams and managing project delivery.
Solid client-facing and stakeholder management experience.
Technical Skills
Azure Data Factory (ADF)
Azure Databricks
Azure Data Lake Storage (ADLS)
PySpark
Python
SQL Server / T-SQL
Delta Lake
ETL/ELT Frameworks
Data Warehousing Concepts
CI/CD and Azure DevOps
Git Version Control
Data Quality and Data Validation Frameworks
Leadership Responsibilities
Manage and mentor a team of Data Engineers.
Conduct code reviews and architecture reviews.
Support resource planning and team growth initiatives.
Collaborate with cross-functional teams across business and technology domains.
Client Engagement
Act as a trusted advisor to clients.
Lead solution workshops and requirement gathering sessions.
Present technical solutions to business and executive stakeholders.
Manage escalations and ensure successful project delivery.
Build strong client relationships and identify opportunities for enhancement and value creation.