08 Sep
|
Alike Thoughts
|
Hyderabad
08 Sep
Alike Thoughts
Hyderabad
Job Description:
- Pipeline Development: Build and optimize ETL pipelines using Databricks and PySpark.
- Data Integration: Manage data from Azure Data Lake Storage (ADLS Gen2) and multiple formats (Parquet, Delta, JSON, CSV).
- Performance Tuning: Optimize Spark SQL queries, cluster configurations, and partitioning strategies.
- CI/CD: Use GitHub Actions or Azure DevOps for workflow automation.
- Qualifications:
- 5+ years IT experience, with 23 years in Databricks.
- Solid skills in Python, PySpark, SQL.
- Familiarity with ADF, ADLS Gen2, Azure SQL.
📌 Azure Data Engineer (Hyderabad)
🏢 Alike Thoughts
📍 Hyderabad