Seeking a Specialist with 5 to 7 years of experience in designing and implementing scalable data engineering solutions using Azure SQL and Databricks within the Azure Databricks skill cluster family.
Job Description Design develop and maintain scalable and productive data pipelines and ETL processes using Azure SQL and Databricks. Collaborate with source data application teams and product owners to understand data requirements and deliver robust analytics solutions. Utilize Azure SQL and Databricks for data ingestion transformation storage and processing. Implement data migration and transformation workflows leveraging Azure cloud services. Ensure data quality and optimize performance of data pipelines. Support continuous integration and continuous deployment CICD pipelines for data engineering projects. Apply best practices for data governance privacy and security within Azure environments. Stay updated with emerging Azure and data engineering technologies and recommend improvements to existing solutions.
Responsibilities
Lead the design and implementation of batch and streaming data pipelines using Azure SQL and Databricks
Provide technical leadership and mentorship to team members on Azure SQL and Databricks best practices
Collaborate with DevOps teams to manage deployment monitoring and support of data engineering solutions
Troubleshoot and resolve data pipeline issues ensuring high availability and reliability
Participate in architectural discussions and contribute to the development of coding standards and security guidelines
Engage with crossfunctional teams to align data engineering efforts with business objectives
Drive automation of data workflows and improve operational efficiency
Support production settings with timely incident response and root cause analysis
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Specialist Data Engineering Kolkata
🏢 LTM
📍 Kolkata
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.