Job highlights
- 8+ years Data Engineering with 3+ years Databricks expertise; skilled in SparkSQL, PySpark, Python, Delta Lake, and CI/CD
- Design scalable Databricks Lakehouse architecture, lead ETL migrations, implement automation and governance, and provide technical oversight
Please share resume at
[email protected]
Role Summary
Senior technical leader responsible for designing scalable Databricks lakehouse architecture, reusable ETL frameworks, automation, governance, and performance engineering.
Key Responsibilities
- Design Databricks Lakehouse architecture (Bronze/Silver/Gold)
- Define clustering, scaling, and performance strategies
- Architect reusable ingestion & transformation frameworks
- Define CI/CD and DevOps automation strategy
- Implement governance by Unity catalog
- Lead migration strategy from DataStage to Databricks
- Drive automation using AI/accelerators for code conversion
- Provide technical oversight and code reviews
Required Skills
- 8+ years in Data Engineering; 3+ years in Databricks
- Deep expertise in SparkSQL, PySpark, Python, Delta Lake
- Strong cloud experience (AWS preferred)
- CI/CD implementation for data platforms
- Strong performance tuning and workload optimization
- Experience designing large-scale ETL migrations
- Strong SQL and data modeling skills
Positive to Have
- Experience with GenAI/Agentic AI for code conversion, automation, or metadata generation
- Exposure to Infrastructure as Code (Terraform/CloudFormation)
- Experience integrating on-prem DBs (Teradata/Oracle) with cloud
📌 Aws Data Engineer (Hyderabad)
🏢 Wipro
📍 Hyderabad