19 Nov
|
Intellics Global Services
|
Chennai
19 Nov
Intellics Global Services
Chennai
Role & responsibilities :
- Design, develop, and maintain enterprise-scale data solutions using Azure Databricks, Azure Data Factory (ADF), ADLS Gen2, Azure SQL, and Azure Synapse Analytics.
- Implement and support Lakehouse Architecture using Databricks Asset Bundles and up-to-date Azure data platform services.
- Develop scalable ETL/ELT pipelines for data ingestion, transformation, and processing across multiple data sources.
- Build and manage Synapse Pipelines, Synapse Spark workloads, Synapse SQL Pools, Synapse Notebooks, and Synapse Data Flows.
- Lead migration initiatives and modernization of legacy ETL workloads to cloud-native Azure platforms.
- Design and maintain robust data models to support analytics, reporting, and enterprise data management requirements.
- Develop, optimize, and troubleshoot Advanced SQL queries, stored procedures, and database objects.
- Implement Azure Security Patterns and ensure secure access, data protection, and compliance across the platform.
- Manage and optimize data storage solutions utilizing ADLS Gen2 and Azure SQL.
- Perform performance tuning and optimization of Databricks jobs, Synapse workloads, SQL queries,
and end-to-end data pipelines.
- Establish and maintain CI/CD deployment processes using GitLab CI/CD and engineering best practices.
- Participate in code reviews, technical design reviews, and knowledge-sharing activities to improve code quality and team standards.
- Collaborate with architects, business stakeholders, and cross-functional teams to deliver enterprise-scale Azure platform implementations.
- Support Data Governance initiatives, including metadata management, data quality, security, and compliance requirements.
- Work with Apache Airflow for workflow orchestration and scheduling where required.
- Contribute to Snowflake integrations and data platform interoperability initiatives as needed.
- Provide production support, root cause analysis, incident resolution, and continuous platform improvements.
- Drive engineering best practices and contribute to the overall architecture, scalability, and reliability of the organization's data ecosystem.
Preferred candidate profile Experience in Pyspark, Databricks, Python, Azure, Synapse
📌 Lead Data Engineer (Chennai)
🏢 Intellics Global Services
📍 Chennai