Job Summary
Job Summary Seeking a Specialist with 5 to 7 years of experience in designing and implementing scalable data engineering solutions using Azure SQL and Databricks within the Azure Databricks skill cluster family.
Responsibilities
Design, develop and maintain scalable and effective data pipelines and ETL processes using Azure SQL and Databricks
Collaborate with source data application teams and product owners to understand data requirements and deliver robust analytics solutions
Utilize Azure SQL and Databricks for data ingestion transformation storage and processing
Implement data migration and transformation workflows leveraging Azure cloud services
Ensure data quality and optimize performance of data pipelines
Support continuous integration and continuous deployment CICD pipelines for data engineering projects
Apply best practices for data governance privacy and security within Azure settings
Stay updated with emerging Azure and data engineering technologies and recommend improvements to existing solutions
Lead the design and implementation of batch and streaming data pipelines using Azure SQL and Databricks
Provide technical leadership and mentorship to team members on Azure SQL and Databricks best practices
Collaborate with DevOps teams to manage deployment monitoring and support of data engineering solutions
Troubleshoot and resolve data pipeline issues ensuring high availability and reliability
Participate in architectural discussions and contribute to the development of coding standards and security guidelines
Engage with crossfunctional teams to align data engineering efforts with business objectives
Drive automation of data workflows and improve operational efficiency
Support production environments with timely incident response and root cause analysis
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Specialist Data Engineering Kolkata
🏢 LTM
📍 Kolkata