- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks.
- Work with Azure Data Lake Storage (ADLS) to manage large-scale data storage and processing.
- Write productive, maintainable, and reusable Python scripts for data manipulation and transformation.
- Develop and optimize complex SQL queries for data extraction, reporting, and analytics.
- Collaborate with data analysts, data scientists, and business stakeholders to gather requirements and deliver data solutions.
- Implement best practices for data governance, data quality, and data security.
- Monitor and troubleshoot production data workflows to ensure reliability and performance.
- Document data processes, pipelines, and architecture.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.