10 Sep
|
ZecData Technology
|
Pune
10 Sep
ZecData Technology
Pune
Data Engineer – Databricks
Experience: 5–7 Years
Location: As per requirement
We are looking for an experienced Data Engineer – Databricks with strong expertise in designing, developing, and maintaining scalable data pipelines and data engineering solutions using the Databricks ecosystem.
Key Responsibilities
Design and develop scalable ETL/ELT data pipelines using Databricks.
Develop solutions using PySpark, Spark SQL, and Python.
Work with Delta Lake for reliable and scalable data processing.
Build and optimize data pipelines using Databricks Workflows.
Perform data transformation, cleansing, validation, and optimization.
Work with cloud data platforms such as Azure/AWS.
Optimize Spark jobs, queries, and data processing performance.
Implement data quality, monitoring, and error-handling mechanisms.
Collaborate with Data Scientists, Analysts, and other engineering teams.
Required Skills
5–7 years of experience in Data Engineering.
Solid hands-on experience with Databricks.
Robust PySpark / Apache Spark / Spark SQL skills.
Excellent Python and SQL knowledge.
Experience with Delta Lake and Databricks Workflows.
Experience in ETL/ELT and data pipeline development.
Positive understanding of data warehousing and data lake architecture.
Experience with Git and CI/CD.
Cloud experience in Azure or AWS is preferred.
Pay: ₹50,000.00 - ₹90,000.00 per month
Benefits
Health insurance
Provident Fund
Work Location: In person
📌 Data Engineer – Databricks Pune
🏢 ZecData Technology
📍 Pune