- Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into a centralized repository.
- Collaborate with cross-functional teams to understand business requirements and design scalable data models that meet those needs.
- Develop complex SQL queries to optimize database performance and troubleshoot issues related to data quality, integrity, and security.
- Ensure compliance with industry standards for data governance, privacy, and security by implementing robust access controls on sensitive datasets.
Job Requirements :
- 10-12 years of experience in IT Services & Consulting with expertise in ADF development.
- Strong understanding of business intelligence concepts such as reporting tools like Power BI or Tableau.
- Proficiency in Python programming language for scripting automated tasks within an organization's DevOps workplace.
- Experience with data modeling techniques using relational databases like SQL Server Management Studio.