15 Oct
|
Alike Thoughts
|
Bengaluru
15 Oct
Alike Thoughts
Bengaluru
- Pipeline Development: Build and optimize ETL pipelines using Databricks and PySpark.
- Data Integration: Manage data from Azure Data Lake Storage (ADLS Gen2) and multiple formats (Parquet, Delta, JSON, CSV).
- Performance Tuning: Optimize Spark SQL queries, cluster configurations, and partitioning strategies.
- CI/CD: Use GitHub Actions or Azure DevOps for workflow automation.
- Qualifications
- 5+ years IT experience, with 23 years in Databricks.
- Robust skills in Python, PySpark, SQL.
- Familiarity with ADF, ADLS Gen2, Azure SQL.
📌 Azure Data Engineer (Bengaluru)
🏢 Alike Thoughts
📍 Bengaluru