This position requires a robust technical leader with extensive experience in Databricks, PySpark, AWS Cloud Technologies, Data Engineering, and team leadership. The individual will be responsible for leading the design and delivery of enterprise-scale data and analytics solutions while managing and mentoring a team of engineers.
Key Skills Required:
- Databricks
- PySpark / Apache Spark
- AWS (S3 and other ETL Services)
- Python and SQL
- Data Lakehouse / Delta Lake Architecture
- ETL / ELT Frameworks
- Data Modeling and Data Warehousing
- CI/CD, GitHub, DevOps Practices
- Agile Delivery and Stakeholder Management
- Strong Team Leadership and Mentoring Experience
Experience:
- (10-12)+ years of overall IT experience
- 5+ years in Technical Leadership / Team Management roles
- Proven experience leading large-scale Data Engineering and Cloud Transformation initiatives
Role Responsibilities:
- Lead architecture, design, and implementation of data platforms using Databricks and AWS.
- Manage and mentor a team of Data Engineers and Technical Leads.
- Drive project delivery, stakeholder engagement, and technical governance.
- Establish engineering best practices, code quality standards, and operational excellence.
- Collaborate with business, architecture, and cloud teams to deliver scalable data solutions.