09 Sep
|
Alike Thoughts
|
Hyderabad
09 Sep
Alike Thoughts
Hyderabad
Job Description:
Pipeline Development: Build and optimize ETL pipelines using Databricks and PySpark.
Data Integration: Manage data from Azure Data Lake Storage (ADLS Gen2) and multiple formats (Parquet, Delta, JSON, CSV).
Performance Tuning: Optimize Spark SQL queries, cluster configurations, and partitioning strategies.
CI/CD: Use GitHub Actions or Azure DevOps for workflow automation.
Qualifications:
5+ years IT experience, with 23 years in Databricks.
Solid skills in Python, PySpark, SQL.
Familiarity with ADF, ADLS Gen2, Azure SQL.
📌 Azure Data Engineer Hyderabad
🏢 Alike Thoughts
📍 Hyderabad