- Design, develop, test, deploy, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions.
- Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures that meet business needs.
- Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks.
- Implement automated testing frameworks such as Pytest or Unite Testing to ensure high-quality code delivery.
- Participate in Agile development methodologies like Scrum to deliver projects on time.
Desired Candidate Profile
- 3-7 years of experience in Data Engineering with expertise in Azure Data Factory (ADF), Pyspark, SQL, and Azure Cloud technologies.
- Bachelor's degree in Any Specialization (B.Tech / B.E.).
- Experience working with cloud platforms like AWS or GCP is an added advantage.
Role: Data Engineer, Industry Type: Miscellaneous, Department: Engineering - Software & QA, Employment Type: Full Time, Permanent Role Category: Software Development Education UG: B.Tech / B.E. in Any Specialization Key Skills Skills highlighted with ‘‘ are preferred keyskills Data EngineeringSQL Azure Data FactoryPysparkAzure Cloud