- Design, develop, test, deploy and maintain large-scale data pipelines using Azure Databricks, AWS Data Bricks, ETL processes.
- Collaborate with cross-functional teams to gather requirements and design solutions for complex business problems.
- Develop high-quality code in Python using PySpark and SQL to process large datasets on Microsoft Azure platform.
- Ensure scalability, reliability, security and performance of the system by monitoring its behavior under various loads.
Job Requirements :
- 5-10 years of experience in Lead Data Engineer role with expertise in Azure Databricks, AWS Data Bricks, ETL processes.
- Solid proficiency in Python programming language with experience working with PySpark.
- Experience working on big data technologies such as Hadoop ecosystem (HDFS), Spark (Scala/Python) etc.
📌 Lead Data Engineer (Ahmedabad)
🏢 DynaTech Systems
📍 Ahmedabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.