Roles and Responsibilities :

- Design, develop, test, deploy and maintain large-scale data engineering solutions using Python, PySpark, SQL, and other relevant technologies.

- Collaborate with cross-functional teams to identify business requirements and design scalable data pipelines that meet those needs.

- Develop automated testing frameworks using CI/CD tools like Azure DevOps to ensure high-quality code delivery.

- Troubleshoot complex technical issues related to data processing, machine learning models, and API integrations.

Job Requirements :

- 7-12 years of experience in Data Engineering with expertise in Artificial Intelligence, Machine Learning, or similar fields.

- Solid proficiency in Python programming language with experience working with libraries such as Pandas, NumPy, Matplotlib.

- Experience with big data technologies like Hadoop ecosystem (HDFS), Spark (PySpark) and cloud-based platforms like Microsoft Azure.

📌 Lead Engineer (Bengaluru)
🏢 Astar Data
📍 Bengaluru