Responsibilities:
Design, develop, and maintain scalable data ingestion, transformation, and delivery pipelines.
Build ETL/ELT solutions using Azure Databricks, PySpark, and Azure Data Factory (ADF).
Develop and optimize Databricks notebooks, workflows, and scheduled jobs.
Implement and maintain Delta Lake-based Bronze, Silver, and Gold data layers.
Integrate data from databases, APIs, files, and cloud storage platforms.
Ensure data quality, performance, reliability, and operational support for production pipelines.
Collaborate with architects, analysts, and business stakeholders to deliver data solutions.

Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.
10+ years of experience in Data Engineering and Data Warehousing.




4+ years of hands-on experience with Azure Databricks and PySpark.
Experience working in Agile/Scrum settings.
Excellent communication and problem-solving skills.

Skills: Azure Databricks (PySpark, Spark SQL, Delta Lake), Azure Data Factory (ADF) ,Databricks Jobs & Workflows, Azure Data Lake, Storage (ADLS Gen2), Azure SQL Database /SQL Server, ETL/ELT Design & Development, Data Ingestion &Data; Transformation, Data Modeling & Data Warehousing, Performance Tuning & Optimization, CI/CD, Git, Data Quality, Monitoring, and Production Support

📌 Data Engineer Databricks Hyderabad
🏢 Atyeti
📍 Hyderabad