22 Sep
|
Proso AI Technologies
|
Noida
22 Sep
Proso AI Technologies
Noida
We are looking for an experienced Azure Databricks Engineer to join our team on a full time basis. The ideal candidate should have strong hands-on experience with Azure Databricks, data engineering, and building scalable data solutions on the Azure platform.
Role Details
Position: Azure Databricks Engineer
Experience: 7+ years of relevant experience
Employment Type: Full-Time
Joining: Immediate Joiners preferred
Shift: Starting from 2:00 PM IST
Key Responsibilities
Design, develop, and maintain scalable data engineering solutions using Azure Databricks.
Develop and optimize ETL/ELT pipelines for large-scale data processing.
Work extensively with PySpark, Spark SQL, and Python.
Build and manage data pipelines using Azure Data Factory (ADF) and other Azure data services.
Implement data ingestion, transformation, cleansing, and aggregation processes.
Optimize Spark jobs, Databricks notebooks, clusters, and SQL queries for performance and cost efficiency.
Work with Azure Data Lake Storage (ADLS) and modern data lake/lakehouse architectures.
Implement data quality, monitoring, error handling, and operational best practices.
Collaborate with data architects, analysts, developers, and business stakeholders to deliver data solutions.
Follow CI/CD, version control,
and deployment best practices across data engineering workloads.
Required Skills
7+ years of relevant experience in Data Engineering / Big Data.
Strong hands-on experience with Azure Databricks.
Excellent knowledge of PySpark, Apache Spark, Python, and SQL.
Robust experience with Azure Data Factory (ADF).
Experience with Azure Data Lake Storage (ADLS).
Good understanding of Delta Lake and Lakehouse architecture.
Experience in performance tuning and optimization of Spark/Databricks workloads.
Hands-on experience with data integration and ETL/ELT processes.
Good understanding of cloud-based data engineering concepts.
Experience with Git and CI/CD practices.
Preferred
Experience with Databricks Workflows, Unity Catalog, and Delta Live Tables (DLT).
Knowledge of Azure Synapse Analytics or other Azure data services.
Experience working with enterprise-scale data platforms.
Databricks or Azure certifications would be an advantage.
Who We're Looking For
We are particularly interested in candidates who can join immediately and are comfortable working in a shift starting at 2:00 PM IST.
Interested candidates can share their updated resume with us to explore this chance with Proso AI.
📌 Azure Databricks Engineer Noida
🏢 Proso AI Technologies
📍 Noida