11 Sep
|
ZecData Technology
|
Pune
11 Sep
ZecData Technology
Pune
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks.
- Work extensively with PySpark, Apache Spark, and SQL for data processing and transformation.
- Develop and optimize ETL/ELT pipelines and data workflows.
- Work with Delta Lake for data storage, processing, and optimization.
- Implement data integration solutions across cloud and on-premise data sources.
- Optimize Spark jobs and Databricks workloads for performance and cost.
- Collaborate with data architects, analysts, and other engineering teams.
Required Skills:
- 5+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks, PySpark/Spark, and SQL.
- Good knowledge of Delta Lake and data warehousing concepts.
- Experience with cloud platforms such as Azure / AWS / GCP.
- Experience in building and scheduling data pipelines.
- Strong understanding of data modeling, ETL/ELT, and performance optimization.
- Positive problem-solving and communication skills.
Preferred:
- Experience with Databricks Workflows, Unity Catalog, and Delta Live Tables (DLT).
- Databricks certification is a plus.
Pay: ₹90,000.00 - ₹120,000.00 per month
Benefits:
- Provident Fund
Work Location: In person
📌 Databricks Engineer(Exp : 5-7 yr) (Pune)
🏢 ZecData Technology
📍 Pune