02 Oct
|
Alike Thoughts
|
India
02 Oct
Alike Thoughts
India
Job Description:
Pipeline Development: Build and optimize ETL pipelines using Databricks and PySpark.
Data Integration: Manage data from Azure Data Lake Storage (ADLS Gen2) and multiple formats (Parquet, Delta, JSON, CSV).
Performance Tuning: Optimize Spark SQL queries, cluster configurations, and partitioning strategies.
CI/CD: Use GitHub Actions or Azure DevOps for workflow automation.
Qualifications:
5+ years IT experience, with 23 years in Databricks.
Robust skills in Python, PySpark, SQL.
Familiarity with ADF, ADLS Gen2, Azure SQL.
📌 Azure Data Engineer Hyderabad (India)
🏢 Alike Thoughts
📍 India