Responsibilities:

- Design, develop, and maintain scalable data ingestion, transformation, and delivery pipelines.

- Build ETL/ELT solutions using Azure Databricks, PySpark, and Azure Data Factory (ADF).

- Develop and optimize Databricks notebooks, workflows, and scheduled jobs.

- Implement and maintain Delta Lake-based Bronze, Silver, and Gold data layers.

- Integrate data from databases, APIs, files, and cloud storage platforms.

- Ensure data quality, performance, reliability, and operational support for production pipelines.

- Collaborate with architects, analysts, and business stakeholders to deliver data solutions.

Qualifications:

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 10+ years of experience in Data Engineering and Data Warehousing.





- 4+ years of hands-on experience with Azure Databricks and PySpark.

- Experience working in Agile/Scrum environments.

- Excellent communication and problem-solving skills.

Skills: Azure Databricks (PySpark, Spark SQL, Delta Lake), Azure Data Factory (ADF) ,Databricks Jobs &

- Workflows, Azure Data Lake, Storage (ADLS Gen2), Azure SQL Database /SQL Server, ETL/ELT Design &
- Development, Data Ingestion &Data; Transformation, Data Modeling &
- Data Warehousing, Performance Tuning &
- Optimization, CI/CD, Git, Data Quality, Monitoring, and Production Support

📌 Data Engineer _ Databricks and Oracle (Hyderabad)
🏢 Atyeti
📍 Hyderabad