18 Nov
|
Acme Services Private
|
Ahmedabad
18 Nov
Acme Services Private
Ahmedabad
Job Description:
- Design, develop, and optimize scalable data pipelines and ETL/ELT processes on Azure using Databricks, Azure Data Factory, and related services.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality data solutions.
- Build and manage data lakes, data warehouses, and lakehouse architectures leveraging Azure Synapse Analytics, Azure Data Lake Storage, and Databricks Delta Lake.
- Implement data ingestion, cleansing, transformation, and integration workflows from diverse data sources including SQL, NoSQL, and streaming platforms.
- Monitor and fine-tune data pipelines and Databricks clusters to ensure performance, cost-efficiency, and scalability.
- Apply data governance, security, and compliance best practices throughout data lifecycle management.
- Support continuous integration and continuous deployment (CI/CD) of data workflows and infrastructure as code (IaC).
- Prepare and maintain technical documentation including architecture diagrams, data flow designs, and operational guides.
- Stay updated with latest Azure data services, Databricks features, and industry trends to recommend cutting-edge solutions.
📌 Azure Data Engineer (Ahmedabad)
🏢 Acme Services Private
📍 Ahmedabad