17 Aug
|
Informica Solutions
|
Bengaluru
17 Aug
Informica Solutions
Bengaluru
Azure Databricks Engineer
Job Title
Azure Databricks Engineer – Design & Solutioning
Experience
7–12 Years
Job Location
Bengaluru
Employment Type
Full time
-
Job Summary
We are looking for an experienced Azure Databricks Engineer with 7–12 years of experience in designing, developing, and implementing scalable data engineering solutions on Microsoft Azure. The ideal candidate will have strong hands-on expertise in Azure Databricks, Azure Data Factory (ADF), data engineering, solution architecture, and technical design.
The candidate will be responsible for translating business and technical requirements into robust data solutions, participating in architecture and solutioning discussions, and leading the implementation of Azure-based data platforms.
Key Responsibilities
- Design and develop scalable and high-performance data engineering solutions using Azure Databricks.
- Design and implement data pipelines using Azure Data Factory (ADF).
- Develop complex ETL/ELT workflows using Databricks and Azure services.
- Work with stakeholders to understand business requirements and translate them into technical solutions.
- Participate in solution design, architecture, estimation, and technical discussions.
- Create technical design documents, data flow diagrams, solution architecture documents, and implementation plans.
- Optimize Databricks workloads, Spark jobs, notebooks, and data pipelines for performance and cost.
- Develop and maintain data transformation processes using Apache Spark/PySpark and SQL.
- Implement data ingestion and integration solutions across multiple data sources.
- Establish appropriate data processing, storage, security, monitoring, and governance practices.
- Troubleshoot performance, data quality, pipeline failures, and production issues.
- Collaborate with data architects, cloud engineers, developers, business analysts, and other technical teams.
- Provide technical guidance and mentoring to junior and mid-level engineers.
- Ensure
📌 Azure Databricks Engineer (Bengaluru)
🏢 Informica Solutions
📍 Bengaluru