Role: Azure Data Engineer (Azure Databricks, PySpark, Python, SQL)
Experience: 5-8 years (adjust to the requirement)
Location / Work mode: [To be filled]
Employment type: [Full-time / Contract]
Role Summary
We are looking for an Azure Data Engineer to design, build and maintain scalable data pipelines and lakehouse solutions on Azure. You will work with Azure Databricks, PySpark, Python and SQL to ingest, transform and serve data for analytics and reporting, working closely with architects, analysts and business stakeholders.
Key Responsibilities
- Design and develop ETL/ELT pipelines using Azure Databricks and PySpark.
- Build and maintain data lake and lakehouse layers (bronze/silver/gold) using Delta Lake.
- Ingest data from multiple sources (databases, APIs, files, streaming) into Azure Data Lake Storage.
- Write productive, well-tested Python and SQL code for data transformation and validation.
- Optimise Spark jobs for performance and cost (partitioning, caching, cluster sizing, handling data skew).
- Orchestrate and schedule pipelines using Azure Data Factory, Databricks Workflows or similar tools.
- Implement data quality checks, logging, monitoring and error handling.
- Apply security and governance practices (access control, secrets management, data masking).
- Use Git-based version control and CI/CD for deployments.
- Document data flows and collaborate with cross-functional teams in an Agile setup.
📌 Walk-in || Azure Data Engineer -Contract To hire (Bengaluru)
🏢 Careernet
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.