Your Role
Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS.
Implementing data validation and quality frameworks to ensure data reliability. Writing effective PySpark and SQL code for complex transformations, aggregations, and performance tuning
Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices
Your Profile
Should have 12+ years of experience in Azure Databricks with robust pyspark experience
Experience with Azure Data Bricks, Data Factory
Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
Experience in Python/Pyspark/Scala/Hive Programming.
Experience with Azure Databricks/ADB
Experience with building CI/CD pipelines in Data environments
Proficiency in data visualization and BI tools, preferably Power BI, with experience in developing complex reports and data models
Robust understanding of data warehousing concepts, data and ETL/ELT best practices.
Application Question(s):
What Is Your Current Salary? *
What Is Your Expected Salary? *
What Is Your Notice Period ? *
Location:
Chennai, Tamil Nadu (Preferred)
Work Location: Hybrid remote in Chennai, Tamil Nadu
📌 Senior Data Engineer Chennai
🏢 IIPL
📍 Chennai