Key Responsibilities
- Design and develop robust ETL pipelines and data integration solutions on Azure.
- Build scalable cloud-native data engineering solutions.
- Write optimized SQL queries for complex business requirements.
- Develop and maintain Python-based data processing frameworks.
- Work with large-scale data processing using PySpark and Databricks.
- Collaborate with business and technology teams to deliver data-driven solutions.
Required Skills
*SQL & Python (Mandatory)*
- Robust SQL expertise.
- Experience with transformations, aggregations, and performance tuning.
- Strong Python programming skills for Data Engineering applications.
*Azure Data Services*
Hands-on experience with:
- Azure Data Lake Storage Gen2 (ADLS)
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
*Data Engineering Technologies*
- Snowflake (Good to Have)
- ETL Development
- PySpark
- Databricks