Job Title

Job ID - IND170694 - EFS FCRM

Data Engineer - AWS Databricks - GenAI

Must-Have Skills

- AWS Databricks (Hands-on implementation experience)
- Apache Spark / PySpark
- Python
- SQL
- Delta Lake
- Databricks SQL
- Unity Catalog
- ETL/ELT Pipeline Development
- Data Lakehouse Architecture
- CI/CD for Data Pipelines
- AWS Cloud Platform
- AI / Generative AI / Agentic AI exposure

Preferred Certifications

- Databricks Certified Data Engineer Associate/Skilled
- AWS Certified Data Analytics
- AWS Certified Solutions Architect (Good to have)

Key Responsibilities

- Design and develop scalable ETL/ELT pipelines using Spark on Databricks.
- Build and manage Lakehouse architectures using Delta Lake.
- Implement orchestration using Databricks Workflows.
- Develop CI/CD pipelines using GitHub Actions, Databricks Repos, and AWS tools.
- Optimize pipeline performance and troubleshoot production issues.
- Manage data governance using Unity Catalog.
- Support batch and streaming data processing workloads.
- Contribute to AI/GenAI-enabled data solutions.

📌 AWS Data Engineer (Databricks) (Hyderabad)
🏢 ADP
📍 Hyderabad